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Background 

Behaviour in schools and classroom management has been the focus of a great deal of 
research, theory, policy and media attention (Ball et al., 2012). Despite this, pupil behaviour 
remains a challenging area for all stakeholders in the education of children and young 
people and is commonly cited as one of the most difficult tasks that both experienced and 
new teachers have to contend with in schools (Barmby, 2006; Jennings & Greenberg, 2009; 
Kokkinos, 2007). Research suggests that both (i) understanding of pupil behaviour and (ii) 
how best to train and support teachers to manage pupil behaviour is contested (Beaman et 
al., 2007; Powell & Tod, 2004). Todd & Ellis (2018) highlight that many in education have a 
view on what behaviour management is, how it should be approached and a conviction that 
more can be done. Although there is certainly no consensus across the sector, support can 
be found in a plethora of guidance and advice resources, from websites to training 
consultants. This support can over simplify the complexity in achieving a complete 
understanding of behavioural influences, behaviour management and the evidence base 
needed in the field. 


Defining behaviour is not straightforward and there are many alternative definitions 
(Department for Education, 2012). Behaviour at its broadest can relate to any action that 
schoolchildren take and therefore could relate to choices about relationships with peers, 
eating and physical activity. While important, such behaviours are outside of the remit of this 
review, which is focused more on understanding school and classroom behaviour that 
affects learning and either meets or challenges the expectations for pupil conduct at school. 
However, “behaviour” in the context of this review does not only refer to poor behaviour or 
misbehaviour, such as Cameron’s (1998) classification that specified the following 
categories; aggressive behaviour, physically disruptive behaviour, socially disruptive 
behaviour, authority-challenging behaviour and self-disruptive behaviour. In this review, we 
also include positive behaviour for learning (Ellis & Tod, 2018), such as concentration, 
prosocial behaviour and engagement are relevant. So our definition of behaviour includes 
both negative and positive actions that are open to subjective interpretations, even to the 
extent a specific behaviour may be of concern to one teacher but not to another, or of 
concern in the classroom but not on the playground (Watkins & Wagner, 2000). 


Difficulties in classroom management often lead to stress, burnout and exit from the teaching 
profession (Aloe et al., 2014), as well as being a deterrent for those considering teaching as 
a career (Day et al., 2006; DfE. 2010; Jacobson, 2016; Ozdemir, 2007). It is also cited as a 
challenge for headteachers across all school phases (Leithwood & Day, 2008). Ineffective 
classroom management can lead to pupil disengagement, aggression, low attendance and 
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bullying (DfE, 2010; Zyngier, 2007). There is a need not just for interventions and strategies 
that target the severe behaviour concerns that arise from a minority of students, but also the 
low level disruption that can be a concern across classes to the point that it may undermine 
learning (Ofsted, 2014). However, recent data from Ofsted indicates that behaviour in 
schools is generally good with Ofsted giving 85% of all schools overall good or outstanding 
ratings (Ofsted, 2019a). Also, from a teacher voice survey (Department of Education, 2018) 
86 per cent of senior leaders rated behaviour as good or very good, yet this reduced to 59 
per cent for classroom teachers. The behaviour from the majority of children and young 
people in the majority of schools is therefore good. 


Schools cannot function well if pupils are frequently absent or do not feel safe. While 
attendance at school and bullying are not wholly the preserve of schools (DfE, 2015), 
schools have an important role to play, this is of particular concern as ‘... both authorised 
and unauthorised absence rates have increased since last year, the rate of the latter now 
being the highest since records began’ (DfE, 2019, p. 1). While there is a lack of clear 
statistics reporting the incidence of bullying in schools, NSPCC report that they have a call 
from a child on average every 25 seconds and 1 in 5 children have suffered abuse or neglect 
(NSPCC, 2018). Increasing school absence (DfE, 2016) or being bullied (Brown, 2018) are 
linked to lower attainment. For a focus on preventing bullying see the systematic review and 
meta-analysis from Ttofi and Farrington (2009). Hence, school approaches to prevent and 
respond to absences and bullying are likely to involve the creation and sustained high quality 
behaviour management throughout the whole school with support from parents and other 
stakeholders. 


In light of concerns regarding increases in school exclusions, and that despite the same 
school exclusion framework applying to all state funded schools in England, there are 
variations ‘... in exclusion rates between schools, areas of the country, and pupils with 
different characteristics’ (DfE, 2018a, p.1), t recently published Timpson Review 
commissioned by the DfE reviewed school exclusions (DfE, 2018a) and also considers the 
practice of off-rolling (Timpson, 2019). Of more relevance here, this review will examine the 
‘practice in schools in relation to behaviour management and exclusions. This includes 
identifying effective approaches which improve outcomes, particularly for those groups 
disproportionately likely to be excluded.’ (p. 2). 


Tom Bennett’s independent review of behaviour in schools focusses on the approaches 
school leaders can take to develop the culture in their schools to ‘promote excellent 


behaviour’ (Bennett, 2017, p. 30). With reference to examples and case studies he asserts 
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that leaders ought to focus on whole school culture to benefit behaviour, rather than 
focussing on teachers in isolation. These approaches are presented as recommendations 
that ‘... reflect the three stages of promoting a school culture that deliberately and carefully 
optimises conduct, character and academic achievement - designing the culture, building the 
culture in detail and maintaining the culture.’ (p.30). He concludes with cautionary advice 
that schools need to adhere to the recommendations clearly, consistently, and realistically 
across the school, but nonetheless with high expectations of what can be achieved. There is 
recognition of a variety of obstacles to achieving this adherence, so the review offers some 
suggestions for school leaders. In addition, Ofsted are reviewing their framework for 
inspection to focus separately on firstly school’s management of behaviour and pupil 
attitudes, and secondly on personal development. Behaviour and attitudes incorporates 
related aspects including study skills, resilience and relationships across the school body 
(Ofsted, 2019b). 


How “behaviour” has been viewed in the above and other policy related documents has 
changed and this may influence the actions of schools. Reports such as ‘Pupil Behaviour in 
schools in England’ (Department of Education, 2012) and ‘Below the radar’ (Ofsted, 2014) 
signified ‘official’ concerns about the impact of misbehaviour on attainment and wellbeing. 
These concerns have manifested themselves in different ways, for example, more emphasis 
on discipline, although the new Common Inspection Framework distinguishes between 
behaviour and discipline and pupils’ wider personal development (Ofsted, 2019b). More 
recently off-rolling (Timpson, 2019) and mental health and wellbeing (Department of 
Education, 2018b) have all had increased focus. As these are commonly linked to behaviour 
in schools, there has been increased guidance and regulations regarding the approach and 
actions schools could and must take to manage behaviours. 


Both reactive and preventative interventions may improve behaviour, while a reduction in 
challenging behaviour can also help to improve other variables such as classroom climate, 
attendance and attainment (Gastic, 2008; Marzano & Marzano, 2003). Previous reviews of 
research that investigated the effectiveness of classroom management or whole school 
approaches have been conducted but often focus on a particular type of intervention or 
outcome (Korpershoek et al., 2016; Oliver et al., 2011; Whear et al., 2013; Wilson & Lipsey, 
2007). Models focusing on explaining pupil behaviour need updating and clearer links to the 
evidence they use to explain school behaviour (Powell & Tod, 2004; Scheuermann & Hall, 
2015). Such models are often used in teacher training texts (e.g. Cooper & Elton-Chalcraft, 


2018; Glazzard et al., 2014; Graham-Matheson, 2014; James, 2016), so there is scope for 


this review to contribute to teachers’ understanding of behaviour. 


Teachers want their pupils to learn, hence behaviours that are disruptive to a child’s own 
learning or that of others in their class can be viewed as behaviours to ‘manage’. However, a 
shift of focus from managing a child’s behaviour and towards teaching a child learning 
behaviours may be beneficial (Bitsika, 2003; Ellis & Tod, 2018; McDermott et al, 2001; 
Nolan, 2011; Norwich & Rovoli, 1993; NUfez and Leén, 2015; Powell & Tod, 2004). While 
accepting that teachers will need to manage behaviour at times, promoting learning 
behaviours could be seen as not only in the interest of the child and their peers in class but 
also of the whole school, as well as the child throughout their education and adulthood. 
Moreover, a focus on teaching learning behaviours seems to fit well with the role of a 
teacher and be in their sphere of control, whereas managing a child’s misbehaviour may be 
complex and challenging. Furthermore, even if a teacher successfully manages a child’s 
behaviour this does not necessarily lead to that child learning. The Behaviour for Learning 
conceptual framework (see figure 1) identifies three core pupil relationships, those with self, 
others, and the curriculum. Each relation impacts on the other, and positive change can be 
achieved by recognising which of these relationships need to be developed or strengthened 
(Ellis & Tod, 2018). 


2018, p.38). 


Figure 1. The behaviour for learning conceptual framework, from Ellis & Tod ( 


While there are a variety of interventions that teachers can focus on at a class level and 
members of school staff can be trained to target undesirable behaviours, school behaviour 
approaches can also involve consistency and coherence at a whole school level. These 
often relate to promoting inclusion, school culture, positive role models and organisational 
principles (Adolphus et al, 2013; Bodin, 2016; Bradshaw, 2012; Garner, 2011; Hershfeldt et 
al, 2009; Smith, 2010). Public Health England (2015) provide a model of elements of a whole 
school approach for wellbeing interventions, this may be of relevance in considering whole 
school approaches to behaviour (see figure 2). 


However, there are a very wide range of interventions that may theoretically improve aspects 
of school behaviour. Reviewing all of these would be a prohibitively large task and would 
duplicate existing high quality reviews (e.g. Bruhn et al., 2015; Daly-Smith et al., 2018; 
Evans et al., 2003; Flower et al., 2014; Korpershoek et al., 2016; Law et al., 2012; Losinski 
et al., 2014; Machalicek et al., 2007; Maggin et al., 2011; Maggin et al., 2012; McKenna et 
al., 2016; Moore et al., 2018; Whear et al., 2013; Wilson & Lipsey, 2007), including those 
already covered under other areas of EEF focus — examples include social and emotional 
learning, parent engagement, thinking skills and self-regulation, physical activity, social 
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skills, interventions to improve symptoms of externalising disorders. See 
https://educationendowmentfoundation.org.uk/evidence-summaries/teaching-learning-toolkit/ 


Curriculum, 

An ethos and teaching and 
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promotes respect resilience and support 

and values diversity social and emotional 
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support and student voice 
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referral Leadership and management 
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to influence 


efforts to prot 


Staff 
development 
Working with to support their own 
parents/carers wellbeing and that 
of students 


Identifying need and 
monitoring impact of 
interventions 


Figure 2. Principles to promoting a whole school and college approach to emotional health and 
wellbeing. From PHE (2015, p. 6). 


Aims 
This evidence review synthesises the best available international evidence regarding 
approaches to behaviour in schools to: 
e Produce an overarching model or framework explaining why school pupils may 
misbehave (Review 1) 
e Review the effectiveness of classroom-based approaches to behaviour trialled in 
robust research studies (Review 2) 
e Review the effectiveness of school-wide approaches to behaviour and identify the 
gaps for robust research studies to explore frequently used strategies (Review 3) 


e Analyse what components of the universal behaviour interventions predict improved 


behaviour outcomes (Qualitative comparative analysis) 


Review 1 Method 
To provide an overview of evidence on why pupils may misbehave in schools and produce a 


model summarising this evidence, we used the following method: 


Inclusion criteria 

We anticipated that the literature included for this review would be unlikely to include 
intervention studies. Therefore, the following inclusion criteria were specified: 

Article focus: Behaviour of children and young people in school settings. Articles needed to 
include a written or diagrammatic model, framework or explanation that can help to explain 
why school students misbehave. 

Study design/Publication type: Any. We were interested in recording the evidence used to 
inform the frameworks and therefore prioritised review evidence and relevant primary and 
secondary analysis with similar research questions as this review. 

Date: Any 

Language: English only. 

Country. At full text screening we would have excluded any frameworks from countries with 


very different school systems compared to England. 


Search strategy 
On 6" and 7" November 2018 the following databases were searched: 


ERIC, Education Research Complete and the British Education Index (via EBSCOhost), the 
Australian Education Index and ASSIA (via ProQuest), PsycINFO (via OvidSp), Social 
Science Citation Index (via Web of Science), the Cochrane Library and the Campbell 
Library. 

The database searches were designed and run by an information specialist (MR). The 
search combined terms for frameworks/models, behaviour and school. An example search 
strategy can be seen in appendix 1. 

Forwards and backwards citation chasing was performed for one key review of literature 
(Powell & Tod, 2004). 

We also searched the following websites for potentially unpublished literature: Education 
Endowment Foundation; What Works Clearing house; Department for Education; The 
Schools, Students and Teachers Network; Devon LEA; Parentkind. 
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Key journals checked were those where multiple included studies were published. 


Study selection 
References located by the search were uploaded to reference management software 


(Endnote X8) and duplicate studies were removed. Two reviewers screened the titles and 
abstracts, after which DM independently screened all records that were not excluded. Full 
texts were retrieved for those records included at this point. One reviewer initially screened 
all of these and DM independently screened all decisions that were unclear. A PRISMA-style 
flowchart was produced with the reason for exclusion of each full-text article reported (Moher 
et al., 2009). 


Data extraction and quality appraisal 
We extracted study details from included studies including country, design, sample, school 


level; as well as details of the explanatory framework of behaviour detailed in the study. We 
extracted any further information regarding the evidence for the framework (particularly for 
non-primary research studies) as this was the marker of quality appraisal and provided a 
rating as to how evidence-informed the frameworks from studies were. This allowed an 
assessment of evidence for potential explanatory factors for misbehaviour that appear in the 
final model produced from this review. This meant that quality appraisal could be conducted 
at the level of synthesis, by considering the strength and robustness of evidence for each 
explanatory factor linked to behaviour that appeared in the synthesised model. This fits 
quality appraisal recommendations for systematic reviews of intervention effectiveness that 
are interested in several different outcomes (e.g. GRADE, Guyatt et al., 2008). Quality 
appraisal at the level of included study was not considered as there was anticipated to be 
multiple studies providing evidence for some explanatory factors. 


Synthesis 
The synthesis of included studies aimed to produce a model of explanatory factors that may 


inform school behaviour management derived from the evidence reviewed while narrative 
synthesis was conducted to summarise and explain the final model and combine the 
literature that informs it. The model takes into account the strength of evidence that informs 
the factors identified. We consulted with the guidance panel as the model was drafted. 
Therefore, the organisation of explanatory factors into categories has seen a number of 


iterations. 
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Review 1 Findings 


The Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) 
diagram in Figure 3 summarises the process of study selection. Initial database searching 
gave 981 records to title and abstract screen. Seventy-seven of these records were 
considered relevant and their full texts were retrieved and screened, leading to 45 included 
studies. Nine more studies were later included after citation chasing for the Powell and Tod 
(2004) review. The majority of studies excluded at full text were focusing on topics other than 
school behaviour, e.g. violence, bullying, achievement. 
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Figure 3. PRISMA flow diagram showing study selection process for Review 1 
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1,116 records screened 1,005 records excluded 


Screening 


111 full-text articles 57 full-text articles excluded 
assessed for eligibility 


Eligibility 


54 articles included in 
synthesis 


Descriptive synthesis 
The summary details of the included studies can be seen in Table 1. These 54 studies were 


conducted from 1978 to 2018, mainly in the US (n=30), with only nine from the UK. Primary 
data was used exclusively in the majority of studies (n=30 studies), a combination of primary 
and secondary in eight studies, solely secondary data in two studies and the remainder 
(n=14) were review or discussion based. Primary school level participants were the focus in 
14 studies, secondary participants in 12 studies and two studies had an explicit focus on 


special schools. 
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For those studies that reported the sample size, child participants were the focus in the 
majority of studies (n=36), with a range from sample sizes (1 to 5126) Teachers were 
included in 19 studies and parents or carers in nine studies. Eight studies focused on all 
children in an educational setting. Gender was reported in most studies (n=35) with one 
study exclusively focussing on boys. We made a note of where the included studies drew on 
existing models and frameworks in their work, the expectancy-value theory of motivation 
(Wigfield & Eccles 2000) was used as a guiding framework in three studies, but otherwise 
there was little overlap in theoretical frameworks used. In terms of quality appraisal, 
Appendix 2 shows the quality rating of each study and how they map onto each explanatory 
factor. There is typically good quality evidence for the majority of the explanatory factors that 
schools can manage directly. The weaker quality evidence of the link between school 
behaviour and out of school behaviour, ability and culture suggests less dependability in 
these explanatory factors according to evidence located. 
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Table 1. Description of included studies in Review 1. 


Study Country Design Model Findings Sample School % of Age M(SD) Type of sample 
details size level females 

Adolphus UK Literature School Breakfast improves on-task Various All NR NR Special and non-special 

et al. review breakfast behaviours schools 

(2013) program 

Bear & US Primary via Moral There is a reciprocal 133 Primary 45% NR Various levels of 

Rys interviews and development relationship between children adjustment. 

(1994) questionnaires and socio- maladjustment behaviours 

economic status and socio-economic status 

Bidell & US Primary via School Low self-concept students 92 Secondary 72% 16.26(.09) School counsellor 

Deacon interviews and counselling exhibit disruptive classroom — children selected students with 

(2010) questionnaires behaviours (DCB) and without DCB 

Bitsika Australia Discussion Functional Meaningful and long-term 4 cases All NR NR. An 8, Those with ASD, ADHD, 

(2003) with primary assessment changes to difficult each with 9,10 and anger management 
data via case framework behaviour result from one child 14-year old problems, are disruptive 
studies. teaching the student to child. or uncooperative 

behave differently 

Boon Australia Primary data Interactions of Positive coping strategies 1,050 Secondary NR NR-range Three schools in North 

(2011) via school school moves, protect students from children 12 to 15 Queensland, of different 
records and coping and behavioural problems years socioeconomic status. 
questionnaires achievement 

Borders et US Primary data Expectancy- Behavioural problems may = 121 Secondary 62% 16(1.22) English teachers and their 

al (2004) via value theory result from a perceived lack — children students in a multi-ethnic 
questionnaires of valued or feasible and 4 urban community. 

alternative behaviours teachers 


Study Country Design Model Findings Sample School % of Age M(SD) Type of sample 
details size level females 
Cadieux Canada Primary data Grade retention Classroom behaviour is 67 Primary 48% In the first Children from 3 school 
(2003) viaa related to factors other than — children year 83 districts of the Outaouais 
longitudinal grade retention and their months region in the province of 
study teachers (SD= 5.1) Quebec 
Caughy et US Primary data Integrated Lower levels of parental 405 In or 49.9% NR Families from Baltimore 
al (2007) via interviews, Process Model eliciting Ne’ were families entering City neighbourhoods 
observations associated with higher primary 
and question- levels of internalizing and 
naires. Secon- externalizing behaviour and 
dary data viaa lower levels of positive 
census school adjustment 
Cheung Hong Primary data Control and Peers deviant behaviour is 1139 Secondary 56% M=14.8 From schools randomly 
(1997) Kong via a Survey labelling theory asignificantly better children Range 12 selected from urban 
predictor of a child’s to 20 years areas, new towns and 
deviant behaviour than rural areas 
media use, family, or 
school variables 
Chirinos US Primary data Expectancy- Student perception of 2,488 Secondary 50% NR From the 2012 U.S. PISA 
(2018) via exam and value theory of control and attributing children. dataset., randomly 
questionnaire motivation academic success to effort selected from 162 public 
secondary can influence behaviours and private schools 
data via PISA 
Cornwall UK Discussion Cognitive- Understanding the human NR Primary to NR NR Emphasis on those likely 
(2015) and opinion behaviour and element underpins teaching secondary to be excluded 
social challenging and vulnerable 
construction - young people and improves 
the ‘human the leaner-teacher 


element’ model 


relationship generally 


Study Country Design Model Findings Sample School % of Age M(SD) Type of sample 
details size level females 
Daniels & UK Descriptive Framework for Variations in any aspects of N/A All NR NR All 
Williams paper Intervention the behavioural 
(1999) environment can have a 
bearing on specific 
examples of behaviour 
Dever US Primary data Expectancy- Student motivation can be 5,126 Secondary 52.80% NR.Range One school district ina 
(2016) via value theory of used to predict the early children grades 9to small city in South-East 
questionnaires motivation precursors of behavioural 12 
and emotional difficulties 
Di Maggio Italy Primary data A mediation Targeting emotional 240 Kindergarte 51% 4.23(0.80) — All attending classes of 
et al via a model knowledge and children n classes of schools in a big city of 
(2016) vocabulary competencies may benefit and their — preschools southern Italy. 
test of children social competence and teachers 
and teacher prevent behavioural 
questionnaires problems 
Dinh etal US Secondary Mediation model Parental involvement, but 330 Primary 50% NR. Range — Hispanic students only. 
(2001) data via of acculturation not self-esteem, plays a children and middle grades 4 to 
annual school and problem significant mediational role schools 8. 
pate behaviour in children’s problem 
proneness behaviour proneness 
DiStefano US Primary data Latent growth Behavioural development 162 Primary 49% NR. Range A racially diverse sample 
& via curve model of follows a linear trajectory, children 6 to 8 from one school 
Kamphau questionnaires child behaviour —_ although rates of decline and their years. 
s (2008) change vary in relation to perceived teachers 


levels of risk 


Study Country Design Model Findings Sample School % of Age M(SD) Type of sample 
details size level females 
Ellis & UK Opinion/views — Behaviour for Schools should focus on N/A All N/A NR All 
Tod learning promoting effective learning 
(2018) behaviours rather than 
stopping unwanted 
behaviours 
Eve US Article and Interrelation- Social control has a greater 300 Secondary 55.2%. M=17 All in South-Eastern city 
(1978) exploratory ship of strain, containment effect on the children school. 
primary data culture conflict motivation for deviant 
via and social behaviour than adherence 
questionnaires control theories to community norms or asa 
response to frustration 
Finnetal US Review of Class sizes Smaller class sizes havea N/A Primary N/A NR All 
(2003) theory and positive impact on learning 
research and social behaviours 
Garner UK Opinion on Role of leaders _—_ Effective promotion of NR Primary N/A NR All 
(2011) documert, in the promotion — positive behaviour and and 
practitioner- of positive learning, can be linked to secondary 
knowledge behaviour leadership 
and research 
Gottfred- US Primary data Grade retention Grade retention does not 401 Middle Promo- Promoted Those who scored in the 
son et al via negatively affect problem children ted group bottom half of the 
(1994). questionnaires behaviour, it does reduce group 12.41 achievement test in 
and secondary rebellious behaviour and 55% (1.27) grades 6 and 7 in two 
data via school increases attachment to retained retained southern, urban schools 
records school group 12.47 


31% 


(1.10) 


Study Country Design Model Findings Sample School % of Age M(SD) Type of sample 
details size level females 
Guleg & Turkey Primary data Teacher Undesirable behaviour 54 Primary 74.1% NR Five schools in Gélctik 
Balgik via perspectives on _ results from family teachers district of the Kocaeli 
(2011) questionnaires undesirable problems, and parental province 
behaviour indifference to education’, 
negative attitudes and 
behaviours, but not boring 
lessons, teacher's 
incapability or lack of 
teaching aids’ 
Hastings UK A review of Actions in Staff behaviour affects NR Special N/A N/A Special education 
(2005) research response to behaviour problems, and educational 
literature severe behaviour problems affect settings 
behaviour are staff behaviour 
escape or 
avoidance 
behaviours 
Haynes US Primary data Self-concept Self-concept dimensions 142 Middle Approx. NR. Range Mainly African-American 
(1990) via and adjustment and general classroom students School 50% 10 to 13 randomly selected 
questionnaires behaviour, group 60 years children in 4 urban 
participation, and attitude teachers schools in North-East 


toward authority are 
correlated 


Study Country Design Model Findings Sample School % of Age M(SD) Type of sample 
details size level females 
Heavenet Australia Primary data A transactional There are bidirectional Teachers Secondary Approx. Grade8 Those children retained or 
al (2009) via model influences between NR. 50% 13.63 with problem behaviours 
questionnaires psychoticism and Children (0.51) 
over 4 years adjustment and behavioural 866 Grade 11 
problems. 16.18 
(0.46) 
Hershfel- US Primary data Double-check: a Double-check canimprove 1 child Primary 0% NR Culturally diverse 
dt et al via acase cultural the behaviour of culturally students 
(2009) study responsiveness and linguistically diverse 
framework (CLD) children. 
Jackson & US Primary via Compensatory, Negative life events are not 140 Primary to 57% NR. Range A representative sample 
Frick questionnaires challenge and associated with adaptive or — children secondary 8 to 13.6 of children from several 
(1998) immunity/ internalizing behaviour. years schools in a semi-rural 
vulnerability Both negative life events southern town 
models and protective factors 


contribute externalizing 
behaviour. Girls with 
significant negative live 
events and social 
support demonstrate less 
internalizing behaviour 


Study Country Design Model Findings Sample School % of Age M(SD) Type of sample 
details size level females 
Kemp & US Primary via Eysenck’s Children with high 150 Middle, 22.70%  13.65(1.9) |General education and 
Center questionnaires personality psychoticism, extraversion children secondary those with emotional and 
(2003) theory and neuroticism traits are at and special behavioural difficulties 
greatest risk of developing day schools matched on the variables 
for severe of age, sex, and race. 
conduct problems. emotional 
problems 
Kerr et al US Primary via Cumulative risk = Children who have both a 193 Primary 48% M=73 Families recruited from 
(2000) interviews and model history of failure-to-thrive children paediatric clinics serving 
secondary via and maltreatment and their inner-city, low-income, 
longitudinal demonstrate more teachers primarily African- 
data behaviour problems and and American families 
worse school functioning parents 
than those who have 
neither 
Knutson US Primary data Social Deficient parenting 671 Primary 51% First grade —_ High-risk neighbourhoods 
et (2004) via interviews, disadvantage involving neglect children and fifth in a medium-sized 
questionnaires and neglectful contributes to the their grade metropolitan area with 
and parenting as development of anti-social teachers high rates of juvenile 
observations precursors to or delinquent behaviour and delinquency 
antisocial and and poor peer relations parents 


aggressive 
behaviour 


Study Country Design Model Findings Sample School % of Age M(SD) Type of sample 
details size level females 
LaRoque US Primary data Peer Group Peers and parents 370 Middle and 51%of §Grades7to Schools around 
(2008) via interviews Processing significantly affect student children secondary those 11 Wisconsin, a rural and 
and Model behavioural decisions. without suburban community, a 
questionnaires Students with EBD disabili- medium-sized city, and an 
perceive less ty, NR alternative school 
encouragement from the rest 
school, parents, and peers 
Liao et al US Primary data Disruptive Following a school shooting NR Primary at 52% Most in Participants of the Linking 
(2015) via behaviour inthe disruptive behaviours baseline grades 1 or the Interests of Families 
questionnaires wakeofa decreases over time 5 and Teachers study most 
and secondary trauma (school of whom were at schools 
longitudinal shooting) within a 15-mile radius of 
data a prior school shooting 
Liasidou Cyprus Theoretical Intersectionality- _ Understanding and N/A All N/A N/A Children with social, 
(2016) paper based policy management students’ emotional and behaviour 
analysis (IBPA) — problem behaviour needs a difficulties 
framework holistic and socially just 
approach 
Lochman US Primary data Contextual Changes in social-cognitive 183 boys, Primary 0% NR - 4th Boys were in the top 22% 
& Wells via social-cognitive processes, schema and their and middle and 5th in teachers’ ratings of 
(2002) questionnaires model parenting practices, even parents, schools grade children’s aggressive and 
among high-risk boys, can and disruptive behaviours 
have a meaningful impact teachers 


on later negative outcomes 


Study Country Design Model Findings Sample School % of Age M(SD) Type of sample 
details size level females 
Lopez & US Primary data Integrative Peer victimization and peer 508 Middle 48% 11 to 13- 6" and 7* graders 
DuBois via model of the rejection contribute children school year olds attending a Midwestern 
(2005) questionnaires _ effects of peer independently to problems community school. 
and secondary victimization and in emotional, behavioural, 
data via school peer rejection and academic adjustment 
records. 
Lorber & US Primary data Mutual Mother's negative—infant 267 Neonatal 45.3% From 7 High-risk urban sample, 
Egeland from exacerbation difficulty pattern may children, days 7and days to 1*t receiving prenatal care 
(2011) longitudinal model support the development of mothers 10; at 3, 6, grade from a public health clinic 
study via significant early conduct and 24, and 42 Mothers 
observations problems teachers months; 20.5(6.6) 
and kindergarte 
questionnaires nand 1* 
grade 
Lyons & Ireland Primary data Integrated With knowledge of context 290 Primary NR for Aged 9 and_ Disadvantaged urban 
O’Connor via model of the and our expectations a children questi- 12. area. 
(2006) questionnaires nature of careful balancing and 29 onnaires 
and interviews — challenging negotiation is needed to teachers 53% for 
behaviour cope successfully with intervie- 
challenging behaviour ws 


Study Country Design Model Findings Sample School % of Age M(SD) Type of sample 
details size level females 
McDermo- US Primary data Structural model Verbal and non-verbal 1268 Primary 50% 6 to 17 A nationally 
tt et al via of student learning play no children through to years of representative (stratified) 
(2001) questionnaires performance appreciable role in and their | secondary age sample 
and behavioural outcomes teachers, 
observations whereas knowledge of parents/ 
with latent motivational and disciplined guardians 
structure behaviour does 
analysis 
Mooij Netherlan A multilevel A multilevel Social behaviour relates to N/A All N/A N/A All 
(1999) -ds theorising model the degree to which a child 
article is a victim or perpetrator of 
aggression or vandalism 
inside and outside school 
as well as a perpetrator of 
criminal behaviour in later 
school years 
Nelsonet US Primary data Temperament Negative emotionality is 75 Pre-school 52% NR. Suburban middle -class 
al (1999) via theory positively related to children, through to Ranged in schools. 
questionnaires externalizing and their primary age from 7 
ina internalizing problems and __ teachers years 1 
longitudinal negatively related with and months to 8 
study positive social behaviours parents years 9 
months 
Nie & Lau Singapore Primary data Self- Behavioural control is a 3196 Secondary 51% 15.5 years 117 grade 9 classrooms 
(2009) via an on-line determination significant negative children in 39 schools. 


survey 


theory 


predictor of classroom 
misbehaviour 


Study Country Design Model Findings Sample School % of Age M(SD) Type of sample 
details size level females 
Nolan US Primary data Oppositional Alienated students seek 30 Secondary N/A Unclear One school in a low- 
(2011) via behaviour social and psychological children income neighbourhood in 
ethnographic theories benefits through 20 staff the Bronx, 99% Black and 
interviews and oppositional behaviour, and 2 law Latino, focussing teacher 
observations hence need positive enforcers characterised ‘chronic 
education and/or political troublemakers’ 
engagement 
Norwich & UK Primary data Affective factors Inalessonachild’s beliefs 28 Secondary 43% NR. 12 Two children of average 
Rovoli via interviews, and learning about what will make it hard — children aged1ito and two of low maths 
(1993) observations behaviours to learn and their 12 years, 8 attainment in each of 
and judgments about carrying- aged 12to eight classes were 
questionnaires out certain learning 13, and 8 selected maths teachers. 
and secondary behaviours are likely to aged 13to Those that had difficulties 
data via school influence their plans to 14 in reading were excluded 
records engage in relevant learning 
behaviours 
Nufez & Spain A review / Psychological Teachers who support N/A All N/A N/A All 
Leén opinion paper —_ needs theory autonomy improve student 
(2015) academic performance, are 


more creative and better 
adjusted, engage more in 
school, and feel less stress 


Study Country Design Model Findings Sample School % of Age M(SD) Type of sample 
details size level females 
Olvera US A review of Hypothesis Anti-social behaviour is 9 school Primary N/A N/A Those children with 
(2008) Emotional Testing (HT) attributed to: lack of psycholo- emotional difficulties 
Disturbance model and a impulse control, parent- gists 
(ED) literature range of anti- child relationship problems, 
and related social behaviour temperament, being 
models, and theories products of their 
an evaluation environment, psychopathic 
of ED mind, attachment problems 
assessment DSM-IV-TR Adapted 
questionnaires Screening Interview was 
thought to be helpful in 
screening childhood 
antisocial behaviour 
Pingault et Canada Primary data Childcare and Receiving childcare 1,544 From pre- 51.4% NR. Data A birth cohort from 
al (2015) via interviews, social behaviour correlates to being less shy — children school children from 5 Quebec, who had relevant 
questionnaires and socially withdrawn, their through to PMK > months, child care and behavioural 
and more oppositional and teachers end of 98%. 1%, 2%, data 
observations aggressive. Differences and PMK _ primary 3%, 4 to 10 
dissipated with age and 12 
years 
Powell & UK Systematic A framework Theories that may 46 studies All NR NR. Age All 
Tod review of reflecting the contribute to understanding range 3-16 
(2004) learning complexity of factors involved in learning years 
behaviour variables that behaviours are affective 
literature influence (self /engagement), 
learning cognitive (curriculum 
behaviour access) and social (social/ 


participation). 


Study Country Design Model Findings Sample School % of Age M(SD) Type of sample 
details size level females 
Richards US Primary data Kohlberg’s Those that reason athigher 87 Two 52% NR 4th, 6th Rural school children 
et al via interviews theory of moral moral levels and girls who children primary and and 8th predominantly from lower 
(1984) and ; development have lower moral reasoning a oe one ? graders eae ae ui as many 
questionnaires Rave lede-condaet eachers — secondary stages of moral reasoning 
as possible. 
problems 
Richards US Primary data Two causal Higher social class, being 60 Two 45% NR. 4 and — Rural school children 
(1989) via interviews models of moral female, and scoring toward — children primary and 8° graders predominantly from lower 
and reasoning and __ either extreme of the moral andtheir — one class homes with as many 
questionnaires = Conduct maturity continuum have teachers — secondary stages of moral reasoning 
as possible. 
less conduct problems. 
Slee Australia = An opinion Furlong's We need to test our N/A All N/A N/A Targets children with 
(2014) essay analysis of theorising across behavioural and cognitive 
student disciplinary networks to defectiveness. 
disaffection and gauge the depth and quality 
links to social of analysis in response to 
theory and bio- student disaffection 
politics. 
Smith US Primary data Social learning Interventions to reduce or 385 Secondary NR NR. 10% Children with disciplinary 
(2010) via theory prevent suspensions must parents or graders referrals from schools with 
questionnaires be undertaken in the school guardians the largest student bodies 


and secondary 
data via school 
records 


context 


in a northwest Louisiana 
school district 


Study Country Design Model Findings Sample School % of Age M(SD) Type of sample 
details size level females 
Sullivan & US Secondary Social Prosocial and anti-social 2,014 Middle 53% 11.5(.68) Socially and economically 
Hirschfie- data via Development development is conditioned — children schools disadvantaged minority 
Id (2011) James Model (SDM) a by the interaction between children. 
Comer’s life course students and social 
School theory contexts (schools, families, 
Development community programs) 
Program 
intervention 
Svendha Sweden Primary Social network Children’s fragmented 190 Primary 44% NR. Children with behaviour 
m (1994) interviews, theory social networks influence children M=11.9 at problems in school 
sociograms, behaviour problems in their grade 5, 
network maps teachers M=12.9 at 
school 
and and grade 6 
questionnaires parents 
Tremblay UK Opinion and Developmental Deficits in using socially N/A All N/A N/A All 
(2010) review trajectories of accepted behaviours are 


disruptive 
behaviours 


intergenerational, based on 
complex genetic and 
environmental 
contributions. Prevention 
requires early, intensive 
and long-term support to 
parents and children 


NR - Not reported; N/A — Not applicable; PMK - Person most knowledgeable about the child. 


Note 1 Eliciting — parents engage in activities chosen by the child, talked to them about their feelings, and allows them to ask questions 


Review 1 synthesis and framework 


There are a myriad of factors which can explain pupil behaviour in schools. The most 
extensive systematic review of the theories of behaviour in education contexts was 
conducted by Powell and Tod (2004) from Canterbury Christ Church University College 
which considered influences such as family, community, policy, and relationship with 
learning. Figure 4 which accompanies this review highlights the convergence of influences 
over behaviour. This diagram is designed to demonstrate the influence of life and 
educational events on individual pupils. If we consider the example of a pupil in Year 8 who 
has experienced the death of a close and influential relative. If prior to this the pupil was 
somewhere in the top right quadrant (optimal position), which indicates that the influences on 
behaviour are positive, the bereavement can start having a negative influence on behaviour 
and the pupil may gradually move through the quadrants (to bottom right then bottom left) 
and thus the influence on behaviour would be moving from positive to negative. These 
changes may be subtle but over time they have a substantial effect on the pupil’s wellbeing 
or academic development. By using this model teachers may be more attuned to events 
which may have an influence over the pupils in their care. As we have mentioned earlier, by 
becoming aware of events before they become extreme then there is more chance of 
mitigating any negative change and thus having more chance of keeping the pupil in positive 


zones, both in terms of overall school behaviour and overall influences. 


Loeber and Farrington (1999) state that intervention is ‘never too early and never too late’ 
when discussing ‘serious and violent juvenile offenders’. However, in an education setting 
when behaviour is manifesting in extreme situations the preventative aspect is no longer a 
viable option at that point in time. The key aspect is to prevent the behaviour from reaching 
that situation, if possible. Being in an informed position where one can be aware of variables 
starting or continuing to affect a pupil’s life situation is key to understanding and being 


effective in behaviour management. 
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Figure 4. The link between positive and negative school behaviour and influences. 


Most people will have experienced challenging situations in their life and resilience becomes 
important in facilitating their ability to handle adversity. To take again the example of the 
Year 8 child who had experienced a bereavement: their resilience is likely to also influence 
their behaviour, but also other things that may enable their resilience like a strong social 
support network and access to counselling might mean that such positive influences are able 
to mitigate against adverse events. It is important therefore to appreciate the multiplicity of 
influences on behaviour and how the same new negative influence will interact with other 
influences in different ways for different individuals. Being able to cope with adverse 
situations helps ensure that negative behaviour manifestations will be less common. In 
contrast, developing a negative self-image may be the result of different events that occurred 
during the early life cycle, that in turn may lead to or exacerbate negative behavioural 
manifestations in response to additional adversity. Thus, events outside school may impact 
children’s behaviour directly but also via links to the perception of one’s ability in school that 
can amplify the stress and distress experienced. There are influences on behaviour which 
teaching staff can affect directly, as well as others where there is a potential for teaching 
staff to influence or advise and finally a third category which indicates that the influences 
may be outside the purview of teaching staff. This is indicated in Table 2. 


Pupils who are experiencing challenging situations at home and/or the community will then 


find that difficulties with learning or coping in the school environment may be more profound. 


Negative attributions for success and failure in learning (Chodkiewicz & Boyle, 2016, 2017) 


may become more entrenched which may then lead to a withdrawal from learning. In some 


cases this can lead to the void being filled with negative behaviour, which is sometimes 


linked to maintaining self-esteem and social standing with peers. This can become more 


pronounced in the later primary and secondary years where social skills and peer 


acceptance becomes more valuable (Bosnjak, Boyle & Chodkiewicz, 2017). 


Table 2. Themes evidenced as affecting school behaviour in Review 1 included studies. Organised by 


level of school influence. 


Relationships (G) 


Aspects to Manage Aspects to Identify and | Aspects to be Aware of 
Directl Influence 


Relationships out of 
school (G) 


Home life (G) 


Teacher interest (G) 


Choice of peers (G) 


Sociometric Status (G) 


Social Competency (G) 


Relationship with Others (G) 


Family Functioning (G) 


Relationship with Peers (G) 


Peer Group Perception of 
Consequences (M) 


Witnessing Violence (G) 


Relationship Development (G) 


Family relationships (G) 


Parental Mental Health and 
Wellbeing (G) 


Teacher Connection (G) 


Social Support (G) 


Parental Education Level (G) 


Teaching and Learning (G) 


Home life (G) 


Parental view of Education (G) 


Abuse (G) 


Academic Achievement (G) 


Discipline (G) 


Learning potential (G) 


Parental Involvement in 
Homework (G) 


Culture (M) 


Educational opportunity (G) 


Connection to Curriculum (M) 


Stress and coping (G) 


Culture Conflict (M) 


School organisation (G) 


Adverse Life Events (G) 


Acculturation (M) 


Exclusions/Suspensions (L) 


Adaptive Functioning(G) 
Emotional Functioning (G) 


School Environment (E) 


Behavioural Functioning (G) 


School Ethos/Policies (G) 


Coping and resilience (G) 


School Transitions (L) 


School leadership (G) 


Behaviour management 
approach (G) 


Definition of appropriate 
behaviour (M) 


Behaviour out of school 
(M) 


School & community relations 
(G) 


Anti-Social Behaviour (G) 


Class Size (E) 


Incarceration (L) 


Educational Motivation (G) 


Attitudes and self-concept | Ability (M) 
(G) 


Intellectual Ability (M) 


Academic Expectations (G) 


Attitudes to Learning (G) 


Aspects to Manage Aspects to Identify and | Aspects to be Aware of 
Directl Influence 


Nutrition (E) 


Locus of Control (G) 


Breakfast (E) 


Labelling (G) 


Happiness (M) 


Out of school support (G) 


Personal Perception of 


Social and welfare services 


Consequences (G) 
Self-evaluation (M) 
Emotional regulation (M) 
Attribution for attainment (G) 


(G) 


Key to quality of research (not strength of association): E = Excellent; G = Good; M = Medium; L = Low 

It follows that one of the main advantages teachers might hold when working with students is 
a knowledge of the pupil and his or her situation. Research suggests the positive impact on 
classroom behaviour when teachers know their students well (Sammons et al, 2016; Sizer, 
1992), although, the implication is that information needs to be sought by teachers and 
willingly shared by pupils and parents. In settings where multiple adults frequently work with 
individual pupils, effective communication to colleagues by students’ key adults is important. 
If we consider Figure 4 we can understand that positive influences affect behaviour ina 
strengthening manner. However, negative influences may lead to poor behaviour, and many 
of the factors in Table 2 may operate in both directions depending on their context. A good 
example is the quality of peer relationships or teacher-pupil relationships. Many people will 
move in and out of all four quadrants in Figure 4 over time, depending on life events and 
their ability to withstand adverse situations. A useful part of this review is the recognition 
that if we are able to understand that a child may be vulnerable and at risk of moving into a 
zone of difficulty, because of a particular life event (e.g. parental death, unable to grasp new 
education concept), it may be possible to intervene before a more chronic behaviour pattern 
emerges. More broadly, research suggests that responding to monitoring behaviour is 
important to limit long-term outcomes such as peer rejection and school failure if behavioural 
difficulties become more entrenched (Petersen et al., 2015; Reinke et al., 2009; Tyler- 
Merrick & Church, 2012). 


Review 2 and 3 Methods 


Review 2 aims 
Review 2 focused on the effectiveness of approaches to classroom behaviour management. 
Specific research questions include: 
e What types of classroom management approaches are most effective in improving 
attainment, learning or behaviour of: 


> all pupils? 
> pupils who exhibit challenging behaviours? 
e Which components of approaches, or theories that explain their mechanisms, are 


most promising? 


Review 2 Inclusion criteria 

Population: School-aged children 4-18 years of age. Populations that were exclusively in 
post-16 education institutions (e.g. Further Education Colleges) or preschool were excluded. 
The intervention could be delivered via school staff as well as directly to children. Outcomes 
needed to relate to schoolchildren in the setting. The educational setting could include 
mainstream and specialist settings. Child participants were either all students in the setting 
or a specific group (e.g. conduct disorder, or children with SEN). 

Intervention: An approach, strategy or programme that primarily targets improving student 
behaviour in the classroom and the approach either is delivered in the classroom or trains 
staff who then take action in the classroom, rather than across the school setting. 

Study design: Any randomised controlled trial or quasi-experimental primary research. 
Quasi-experimental research relates to comparisons of intervention and control group when 
the allocation to group is not randomised. Studies with single intervention groups and pre- 
post-intervention measures (no control group) were excluded. Systematic reviews that may 
have relevant studies were retained and their included studies located. 

Outcome: Included studies must have had at least one outcome that would fit the following 
categories: behaviour, attainment, other learning outcomes. 

Date: Any. 

Language: English only. 

Publication type: Peer-reviewed research. Dissertations were excluded. 


Review 3 aims 
Review 3 focused on the effectiveness of school-wide approaches to behaviour 
management. It included both popular whole school approaches to behaviour management, 
as well as effective leadership practices that promote a school culture of positive behaviour. 
Review 3 aimed to answer the following research questions: 
e What types of whole school approaches to behaviour management are most effective 

in improving learning outcomes and behaviours of: 

> all pupils? 

> pupils who exhibit challenging behaviours? 


e Is there evidence that whole school approaches (review 3) are more or less effective 
than classroom-based approaches (review 2)? 

e What gaps for randomised controlled trials and quasi-experimental studies exist for 
frequently used whole school approaches to behaviour management? 


Review 3 inclusion criteria 

Articles were selected according to the following inclusion criteria: 

Population: School-aged children 4-18 years of age. Populations that were exclusively in 
post-16 education were excluded. The intervention may have been delivered to school staff 
to then apply as a whole school approach rather than children receiving the intervention but 
outcomes needed to relate to schoolchildren in the setting. Special Schools and schools with 
particular intakes (e.g. selective on ability, vocational curriculum) were included, therefore 
whole school approaches may be focused on specific types of children, e.g. those with 
social, emotional and mental health difficulties. 

Intervention: An approach, strategy, programme or policy that primarily targets behaviour at 
the whole school level. Whole school approach meant that either study authors identified it 
as a whole school approach, every classroom in the school applied the same intervention or 
elements incorporated behaviour beyond the classroom, e.g. school grounds or behaviour 
before school. The approach was either delivered in the school or trained at least some staff 
with the intention that they effect improvement at a whole school level. The interventions 
may span both staff action and leadership practice. A whole school approach is very likely to 
specify particular action in the classroom. While a single study may fit the inclusion criteria 
for both Review 2 and Review 3, it would only be included in both if it focused on the impact 
of the classroom elements as well as the remainder of the whole school approach. 

Study design: Any randomised controlled trial or quasi-experimental primary research. 
Studies with single intervention groups and pre- post-intervention measures (no control 
group) were excluded. Systematic reviews that may have relevant studies were retained and 
their included studies located. 

Outcome: Included studies must have at least one outcome that would fit the following 
categories: behaviour, attainment, other learning outcomes. 

Date: Any 

Language: English only. 

Publication type: Peer-reviewed research. Dissertations were excluded. 


Search strategy for both Reviews 2 and 3 


Because of the similarities between the inclusion criteria for Review 2 and 3, a single search, 
study selection, data extraction and synthesis process was followed for both reviews. 

The database searches were designed and run by an information specialist. The search 
combined terms for study design, behaviour, school, schoolchildren and intervention. 


Between 28th September and 2nd October 2018 we searched the databases ERIC, 
Education Research Complete and the British Education Index (via EBSCOhost), the 
Australian Education Index and ASSIA (via ProQuest), PsycINFO (via OvidSp), Social 
Science Citation Index (via Web of Science), the Cochrane Library and the Campbell 
Library. 

An example search strategy can be seen in appendix 3. 

Forwards and backwards citation chasing was conducted for all articles included from the 
database search. The included studies from relevant systematic reviews identified from the 
search were also screened for any relevant additional studies. 

We also searched the following websites for potentially unpublished literature: Education 
Endowment Foundation, What Works Clearing house, Department for Education, The 
Schools, Students and Teachers Network, Devon LEA, Parentkind. 

Key journals checked were those where multiple included studies were published. 


Study Selection for Reviews 2 and 3 
References located by the search were uploaded to reference management software 


(Endnote X8) and duplicate studies were removed. Relevant studies were identified in two 
stages based on the inclusion/exclusion criteria given above. First, independent double 
screening of titles and abstracts for each record was conducted by two reviewers. Full texts 
of records that appeared to meet the inclusion criteria on the basis of titles and abstracts 
were then obtained wherever possible via the University of Exeter online library or web 
searching. Each full text article was screened independently by two reviewers (SBC and 
RK). Reasons for exclusion at this stage were recorded. Disagreements were resolved by a 
third reviewer as necessary (DM). During full-text screening any relevant systematic reviews 


were excluded after all relevant included studies from these reviews were screened. 


Data Extraction for Reviews 2 and 3 

Data was extracted from included studies in table format to aid synthesis and comparison 
across included studies. A data extraction form was developed and piloted. Data on article 
details, sample, intervention, outcome measures, findings and study quality were extracted 


into Microsoft Office Excel 2013 (Microsoft, Redmond, CA, USA) by either RK, SBC or LG 
and checked by DM. 


Critical appraisal 
We appraised studies using the Joanna Briggs Institute checklists for randomised and quasi- 


experimental studies (Joanna Briggs Institute, 2017a, 2017b). After piloting the Joanna 
Briggs Institute checklists and the RoB 2.0 (Higgins et al., 2016) and ROBINS-I (Sterne et 
al., 2016) checklists, the former was selected because of ease of use and relevance to 
included studies. The quality appraisal of studies were used to evaluate risk of bias and 
study quality and were not used to exclude papers. 


Categorisation of interventions and outcomes 
During data extraction, interventions were categorised according to similarities in terms of 


broad intervention type and intervention content. The labels and definitions of these 
intervention categories were developed using the descriptions of interventions in the 
included studies. The categorisation was primarily used to organise the quantitative 
synthesis and ensure that groups of studies considered together included interventions that 
were sufficiently similar. 

Given that included studies needed to have at least one outcome measure that fitted either 
behaviour, academic outcomes or other learning outcomes, outcomes were categorised 
using these three categories. We soon found that because interventions focused on school 
or classroom behaviour, there were rarely any outcomes that did not fit these categories. 
When this occurred they were categorised as “other”. Social relationships were an 


exception, appearing as an outcome in several studies. 


Synthesis 
We categorised included studies by: universal or targeted approaches; type of classroom 


management or whole school approach; and school level. We applied these categories to 
synthesise groups of similar studies (e.g. secondary school, teacher training interventions, 
targeting all pupils) describing the studies’ findings in relation to behaviour, attainment, other 
learning and any other outcomes beyond these primary review outcomes. Wherever 
possible we calculated effect sizes for behaviour outcomes for each study to compare 
effects in a consistent manner. 

Differences between intervention and control group means reported at the first time-point 
after the intervention was completed were analysed. Cohen's effect size (d), the 
standardised mean difference, was reported for each outcome measure category. The effect 
sizes and 95% confidence intervals were calculated using the mean, standard deviation and 


the sample size for the intervention and control groups or, if any were not reported, statistics 
that could be used to derive these (e.g. confidence intervals). When two or more measures 
that assessed the same outcome category were reported in a study, the effects were 
combined into one composite effect for that outcome by calculating the effect size for each 
measure and using the mean; we calculated the standard error for this composite effect in 
the usual way using smallest sample size across measures. Scores were analysed so that a 
positive effect size indicates some degree of improvement and a negative effect size 
indicates some degree of deterioration in order to avoid confusion between outcomes that 
might increase prosocial behaviour or reduce misbehaviour. Where effect sizes and 95% 
confidence intervals could not be calculated by reviewers, brief narrative findings are 
reported with reference to the included article. 


Review 2 and 3 Findings 

The Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) 
diagram in Figure 5 summarises the process of study selection. Initial database searching 
gave 4570 records to title and abstract screen. Four hundred and eighty four of these 
records were considered relevant and their full texts were retrieved and screened, leading to 
50 included studies. Additional searches led to 110 more full text records screened and 18 
more studies included. This gave a total of 68 included studies, 56 of which fit Review 2 as 


classroom-based interventions; the remaining 12 fit Review 3 as whole-school interventions. 


Figure 5. PRISMA flow diagram showing study selection process for Reviews 2 and 3 


4,826 records identified 
4,570 records from databases 
256 records from additional 


i= 
2 
~ 
© 
= 
fo 
-~ 
o h 
a) searcnes 


4,826 records screened 4,232 records excluded 


Screening 


526 full-text articles excluded 


594 full-text articles 
assessed for eligibility 


Eligibility 


68 articles included in 
synthesis 
Review 2: 56 studies (31, 
universal; 25 targeted) 
Review 3: 12 studies (all 
universal) 


Review 2 descriptive synthesis 
Synthesis for Review 2 is split at the broadest level between those studies that are delivered 


to universal student populations and those that are delivered to targeted student 


populations. 


Universal interventions 

The summary details of the included studies (n=31) can be seen in Table 3. The included 
studies were published from 1974 to 2018, and most were carried out in the USA (n=19). 
Other countries included UK, Ireland, Norway, Belgium, Canada, Germany, Hong Kong and 
the Netherlands. The study designs included RCTs (n=24) with one (n=20) or two (n=4) 
treatment groups, and quasi-experimental (n=7) studies with one (n=6) or two (n=1) 


treatment groups. The control groups were mostly treatment as usual (n=14) and waitlist 
(n=10). Other controls usually involved offering similar levels of attention to participants 
without exposing them to the actual intervention. Most studies used cluster randomisation 
(n=28). Children were participants in all but one study, with n=20 including both children and 
teacher participants. In addition, one study included wider school staff as participants. 
Sample sizes of participants ranged from 41 to 8350 children, and 6 to 469 teachers. 
Included schools were mostly elementary or primary levels (n=28). The remaining studies 
included samples from middle schools, high schools or secondary schools (n=3). 
Percentage of female children ranged from 24% to 73%, while the percentage of female 
teachers ranged from 60% to 100%. Where reported, children’s mean age ranged from 4.2 


to 13.5 years. 


Table 4 gives details of the interventions used in the included studies. The main categories 
of intervention were teacher training including reward systems (e.g. IYTCM) which mainly 
focussed on classroom management skills; teacher training that did not include reward 
systems (e.g. coaching teachers); reward systems (e.g. GBG), all of which involved training 
teachers. Teacher training interventions were primarily focused on upskilling teachers in their 
behaviour management skills and practice, whereas reward system interventions included 
training on how to use the system; that is they focused on implementing a particular reward 
system rather than explicitly on the teacher developing skills and then applying them as they 
wished. Fidelity was assessed in 19 of the included studies. 


Quality appraisal ratings for each included study are shown in Tables 5 and 6, for RCTs and 
quasi experimental studies respectively. RCTs typically used true randomisation, analysed 
participants in the groups they were allocated to (i.e. intention to treat), measured outcomes 
reliably and used appropriate trial design and analysis. Perhaps unsurprisingly RCTs less 
often blinded participants, assessors and those delivering interventions to treatment 
assignment. Although reporting was often unclear, it was rare for studies to be at risk of bias 
across a wide range of criteria. Only Rogeness (1977) scored particularly poorly, perhaps 
because of the age of the study, although the findings from this study are not particularly 
strong regardless. Quasi-experimental studies scored well (every quality criteria either 
evident or unclear), notwithstanding their non-randomised allocation of groups. 


Table 3. Study characteristics for Review 2 studies for universal student samples 


observed 


Study Country Design | Type of control Sample Sample size School level 
Aasheim 2018 | Norway Quasi | Waitlist Teachers & | 1518 Primary 
students students. 
Bartholomew | USA RCT Traditional sedentary academic lessons. Children 2716 children | Elementary 
et al (2018) only 
Caldarella USA RCT TAU (typical classroom management strategies) | Children & | 350 children Elementary 
2018 teachers 
Capella 2012 | USA RCT Initial training, access to website Mental 12 MH staff. Elementary 
health staff, | 36 teachers. 
teachers, 364 children. 
children 
Dolan 1993 USA RCT TAU First-grade | 864 Elementary 
classrooms, 
all students 
Humphrey UK RCT TAU Children 3084 children | Primary 
2018 and 
teachers 
Evertson USA Quasi | TAU teachers 29 teachers Elementary 
(1989) 
Evertson 1995 | USA Quasi | Waitlist Teachers & | 46 teachers. Primary (grades 1- 
students 420 students 6) 
in study 7. 423 
students in 
study 8. 
Fernandez USA Quasi | TAU Teachers 11 teachers, Kindergarten and 
(2015) and their 118 students first grade 
students classrooms in US 
public school 
Ford 2018 UK RCT TAU Children 2188 children | Primary 
only 
Fossum 2017 | Norway Quasi | TAU/Waitlist (offered training 1 year later) Children 1218 children | Kindergarten 
Gregory USA RCT TAU Teachers 1669 students | Middle and high 
(2014) but their schools 
students 
were 


Han 2005 USA RCT No treatment Children 166 Pre-Kindergarten 
Hickey 2017 Ireland RCT Waitlist Teachers & | 445 children. Primary 
students 
Homer 2016 Hong Kong, RCT Other - non-digital conventional school token Children 120 Elementary 
China point system randomised 
Hutchings UK RCT Waitlist Teachers & | 12 teachers. Primary 
2013 students 107 children. 
Kamps 2015 USA RCT Waitlist Children & | 159 teachers. | Elementary 
teachers 17 schools, 
average 382 
students 
Leflot 2010 Belgium RCT TAU Teachers & | 15 schools. Elementary 
students 570 children. 
McGilloway Ireland RCT Waitlist Teachers & | 11 schools, 22 | Infant 
2010 children teachers, 234 
children at 
baseline 
Murray 2018 USA RCT Waitlist Teachers & | Teachers:97 | Elementary 
students baseline, 
Students: 
1192 
analysed. 
Okonofua USA RCT The control exercise Teachers & | 2069 students | Middle schools 
2016 students recruited 
Piwowar 2013 | Germany Quasi Module 1 only (presumed to represent the Teachers & | 37 teachers. Secondary 
traditional instruction approach) children 666 children. 
Reinke 2012 USA RCT Waitlist Teachers & | Teachers: 105 | Elementary 
children randomised. 
Children: 1817 
randomised. 
Reinke 2018 USA RCT Waitlist business as usual control group Teachers 105 teachers Elementary 
and and 1817 
students students. 
Rogeness USA RCT TAU Children 234 Elementary 
1977 
Spilt 2013 Netherlands | RCT Not reported Children 759 children Elementary 
only from 47 


classes 


Spilt 2016 Belgium RCT Not reported Children & | 30 teachers. Elementary 
teachers 570 children. 
Thompson USA Quasi TAU (no training/assistance) Teachers & | 22 teachers. Elementary 
1974 students Students not 
reported. 
Wills 2016 USA RCT Control. students 313 children Elementary 
and and 169 
teachers teachers 
Wills 2018 USA RCT TAU, offered training in the spring to use the Children & | Teachers: 193 | Elementary 
intervention teachers recruited, 
Class size 18- 
25 students. 
Wills 2018 USA RCT Control. students 157 teachers | Elementary 
and 324 children 
teachers for details 


Table 4. Intervention details for Review 2 studies for universal student samples 


Who receives the 


ion nam Intervention r i 
Study Intervention name femvention category. intervention? 


Who delivers? Duration 


Fidelity assessed? 


Teacher training (including All 1st-3rd grade teachers & 


pasieln 201e7 0tCN reward system) after school service staff 


Bartholomew 


C | j ivi j 
2018 I-CAN! Physical Activity Children 


Teachers receive training and 
given scripted lessons to teach 
children. 


Teacher training (including 


Caldarella 2018 CW-FIT 
reward system) 


Teacher training (no reward 


Capella 2012 BRIDGE 
system) 


Consultants, teachers 


@uad ehaviounGane Teachers given training to 


Dolan 1993 GBG Reward system implement intervention to 
(GBG) 
children 


Experienced & qualified 
group leaders(see page 7 
paragraph 2 for further 
details) 


School year (8-9 months 
between pre & post 
assessment) 


Teacher Monday to Friday 


Research staff train 
teachers, teachers deliver to 1 academic year 
children. 


Unsure who delivers to 
consultants. Consultants 
deliver to teachers. 
Teachers deliver to children. 


1 year 


Teacher delivers to class. 
Unclear who delivers 
training for teachers. 


No 


Not mentioned 


Yes - fidelity 


Mentioned in 
abstract but not 
reported in detail 


No 


Study 


Intervention name __ Intervention category 


Who receives the 
intervention? 


Who delivers? 


Duration Fidelity assessed? 


Evertson (1989) 


Evertson 1995, 
COMP 


Fernandez 
(2015) 


Ford 2018, 
Incredible Years 
Teacher 
Classroom 
Management 
programme 


Fossum 2017 


A School-Based 
Training Programme 


Teacher training (including 
reward system) 


Classroom 

Organisation and Teacher training (including 
Management Program reward system) 

(COMP) 


Teacher-Child 
Interaction Training 
(TCIT) 


Teacher training (including 
reward system) 


Teacher training (including 


1oM reward system) 


Incredible Years 
Teacher Classroom 
Management (lY TCM) 


Teacher training (including 
reward system) 


Teachers 


Teachers 


Only the teachers 


Teachers 


All staff, all children 


Trainers 


Certified COMP workshop 
leader 


Both TCIT trainers were 
clinical psychologists, one a 
Parent-Child PCIT Master 


All teachers in this 
experiment were observed 
on six occasions, four times 
after the first work-shop and 
twice after the second 
workshop in mid-October. 


Tests taken in fall and spring 
terms. 7-8 month interval 

; No 
between mathematics 
assessment. 


Coaching sessions continued 
until a teacher reached the 
pre-set skills mastery for 

both phases of the training or No 


Trainer and the other a PCIT until 24 weeks of training had 


Level | Trainer 


Qualified group leaders 


occurred based on resource 
limitations. 


6 months Yes 


Experienced and qualified 1Y9 months i.e. whole school 


group leaders 


year 


Who receives the 


Study Intervention name __ Intervention category : ; Who delivers? Duration Fidelity assessed? 
intervention? 
hig Teaching Parner Two coaches, who were 
y g Teacher training (no reward Teachers - see intervention both experts in teaching and : 
Gregory (2014) Secondary program ne academic year Yes 
system) description. adolescent development 
(MTP-S) 
coached the teachers 
Program consultants Pre-treatment assessments 
pescnlig Paucel ols: Teacher training (includin delivered teacher training & September/October, post- 
Han 2005 Children, and Parents g g Teachers, children, parents g P +P Yes - fidelity 
reward system) parent groups - two masters-treatment assessments 
(RECAP) eRe. 
level clinicians April/May 
Yes - facilitator- 
Stats de reported fidelity. 
Hickey 2017 IYTP peaeten Talaing (nealing Teachers Trained facilitators 5 months Adherence not 
reward system) 
independently 
validated. 
Homer 2016 ClassDojo Reward system Children Teacher 16 weeks No 
Humphrey Good Behaviour Teachers receive training, then 
R B h 2 Y 
(2018) Game (GBG) eneiasyse implement in classroom eeeCpacies ae oS 
Two trained leaders, a 
Hutchings 2013 IYTCM Reacher salning (IRCIUGING | teachers COMED, PROTA TAGMIOR arte Yes - fidelity 
reward system) (the first author) and a 
trained program leader 
Ces eS EUnClOn: Project staff deliver trainin 
Kamps 2015 Related Intervention Reward system Children é g- 5 months (October to March) Yes - fidelity 
Teachers deliver to children. 
Teams (CW-FIT) 
: Yes - 
Leflot 2010 GBG Reward system Children Teacher 7 months 


"implementation" 


Who receives the 


Study Intervention name __ Intervention category : ; Who delivers? Duration Fidelity assessed? 
intervention? 
; Teacher training (including 
McGilloway 2010IYTCM Teachers Not reported 6 months No 
reward system) 
Teacher training (including sf 
Murray 2018 IYTCM Teachers Trained group leaders 6 months Yes = fidelity 
reward system) 
Okonofua 2016, Goa , First module midway through 
Empathic emipetle Mase! Deacney alnigg (he -leward Teachers Online module fall term. Second module 2. No 
oe Intervention system) 
Discipline months later. 
Unclear - teacher 
Kompetenzen des knowledge on 
Klassenmanagements oto classroom 
lear - ly 1 
Piwowar 2013. (KODEK) "classroom Peacner Seine Mneuelng Teachers Unclear me won Bessy management, 
reward system) academic year aes 
management competencies in 
competencies" classroom 
management (p 5&6 
2 doctoral-level |Y TCM 
group leaders who were 
Reinke 2012 IY- elegbie leaks Teacher training (including supervised by the program le as 
Teacher Classroom Teachers ; 1 academic year Yes - fidelity 
TCM reward system) developer; one of these 


Management (lY TCM) 


trainers also served as a 
coach. 


Who receives the 


Study Intervention name __ Intervention category : ; Who delivers? Duration Fidelity assessed? 
intervention? 
Two doctoral-level lY TCM 
group leaders who were 
ere supervised by the program 
Reinke 2018 IYTCM eacuen taining neliaing Teachers trained developer conducted the full-Approx 6 months Yes 
reward system) are eae 
day trainings; one of these 
trainers also served as a 
coach. 
se Bet { ; i 
nlogenees tone eee} lob) inpemeavon Reward system Initially teachers, then children Mental health consultants acapemic veal replicates No 
counselling & counselling for 2 years 
Spilt 2013 eae Game. sward system Children Teachers 2 years No 
Spilt 2016 Gace Game. eward system Children Teachers 1 academic year Yes - implementatior 
Thompson 1974 Trainings Denewioutleacner taining aneialng Teachers Authors/Researchers Unclear No 
management reward system) 
Class-Wide Function- ; ; 
h | f ON: 
Wills 2016 related Intervention Reward system heaenels Halnea te eee! teae Shoei alte! About 7 months. Fidelity 
intervention to selected children training by coaches 
Teams (CW-FIT) 
Class-Wide Function- 
Teach li f 
Wills 2018 related Intervention Reward system vencnels valine te ceive! ae er eeineteo ane! About 7 months. Yes 
intervention to selected children training by coaches 
Teams (CW-FIT) 
Class-Wide Function- 
March. Repli soit oi 
Wills 2018 Related Intervention Reward system Teachers & children Teachers Oeebere-Mate ae Cate as - fidelity 


Teams (CW-FIT) 


over 4 years. 


Table 5. Review 2 Universal Interventions RCT quality 


Study/Criteria 


6. 


= 
j=) 
= 
— 
=? 
ne) 


—_ 
a 


Bartholomew (2018) 


N 


Caldarella (2018) 


N Note 1 


Capella (2012) 


N Note 1 


Dolan (1993) 


N 


Ford (2018) 


Y 


Gregory (2014) 


iy 


Note 4 


Han (2005) 


N Note 3 


Hickey (2017) 


Y Note 5 


Homer (2016) 


PA 


Humphrey (2018) 


Hutchings (2013) 


Kamps (2015) 


Leflot (2010) 


McGilloway (2010) 


Murray (2010) 


Okonofua (2016) 


Reinke (2012) 


Reinke (2018) 


Rogeness (1977) 


Spilt (2013) 


Spilt (2016) 


Wills (2018) 


Ward (2013) 


Wills (2016) 


<| <| <| <] <}| 2] Cc} <| Cc} «| «] «| «} «) «| 2} «] Cc} 2] <| «) «| </c/= 


<| CC) <) E) eC) 2). 2) eC). €) | <| EC) <) s| Cl Ee) Ss) Ee) 2p s< -e) S) .zz) e| 


Note 6 


Wills (2018) 


Na 


N 


Z| <| <| Cc} 2] <| 2} «) <| c} Cc} Cc} <} Cc} <| 2} Cc] x} <| <| <| «) <| Cc] </ @ 


2| 2) 2) 2) 2) 27) 2S) S| St | S| CS aS S|) S| |) Se) a) eS) Sy oc, | S| 


Z| Z| Z}) 2) Z| Z) 2) Zz) Zz) <] Zz) Zz) 2) Zz) Zz) Zz) Zz) Z| 2] 2) Zz] Zz) Zz oa 


Z|; Zz) Z) Z|) Z| Z|) Z| Cl] <} <| <} <} Z| Z| <}| 2 


e| €) Cc) <| <}) <) 2) Cc) =<) <) 2) Cc) €| Ee) 2) Ee) <)- €) EC) <<) <) X<) 2) 2) | N 


<j <j) CC) 2) Zz) Zz) 2) <) CC) 2] Cc} Z| 2] <} KX) 2] <<} ZZ} <} <} 2) <| <} C)] Cc] @ 


<| <| <| <| <] <| 2] «<) <| <| «| «| «| «| «| «| «| «| «| <| <| «) </ <| </ © 


<| <| <| <| <| <| <| «| «| «| «| «| «| «| «| «| «| «} <| </ «) <| <) </ < 


<| <| <} Cc] <| <} Cc} Cc] <| <} «} «| ~} Cc} «| «} «| «} ~«/} Cc] <) «| <) </ <« 


<| <| <| <} <| 2} 2] <| <| <| «| </| «| «| </ «/ 2/ «| 2| </ <« 


<| <| <| <| <| <| Cc} <| «| «| «| «| «| «| «| «| «| «| «| <| «) «| <) </ < 


Y= Yes, N=No, U=Unclear. 

1. Was true randomization used for assignment of participants to treatment groups? 2. Was allocation to 
treatment groups concealed? 3. Were treatment groups similar at the baseline? 4. Were participants 
blind to treatment assignment? 5. Were those delivering treatment blind to treatment assignment? 6. 
Were outcomes assessors blind to treatment assignment? 7. Were treatment groups treated identically other 
than the intervention of interest? 8. Was follow up complete and if not, were differences between groups in 
terms of their follow up adequately described and analysed? 9. Were participants analysed in the groups to 
which they were randomized? 10. Were outcomes measured in the same way for treatment groups? 11. 
Were outcomes measured in a reliable way? 12. Was appropriate statistical analysis used? 13. Was the 
trial design appropriate, and any deviations from the standard RCT design (individual randomization, parallel 
groups) accounted for in the conduct and analysis of the trial? 


Note 1 Teachers - N. Observers - U. 

Note 2. Teachers - N. Observers - Y. 

Note 3. N - teacher report. U - parent report. 

Note 4. Randomised to district level only 

Note 5. All except one researcher 

Note 6. Apart from significant differences at pre-test on teacher praise 


Table 6. Review 2 Universal Interventions Quasi-experimental quality table 


Study 1. Is it clear in 2. Were the 3. Were the 4. Was 5. Were there | 6. Was follow up | 7. Were the 8. Were 9.Was 
the study what participants participants there a multiple complete and if | outcomes of outcomes appropriate 
is the ‘cause’ included in any | included in any — | control measurements | not, were participants measured in_ | statistical 
and what is the | comparisons comparisons group? of the outcome | differences included in any | areliable analysis 
‘effect’ (i.e. similar? receiving similar both pre and between groups | comparisons way? used? 
there is no treatment/care, post the in terms of their | measured in the 
confusion about other than the intervention/ follow up same way? 
which variable exposure or exposure? adequately 
comes first)? intervention of described and 

interest? analysed? 

Aasheim ¥ yet Unter ¥ Y U Y Y ¥ 

(2018) 

Evertson ¥ nd ¥ ¥ 1 Y ¥ Y Y 

(1989) 

Evertson Y U U Y v U 4 ¥ ¥ 

(1995) 

Fernandez | Y x ¥ ¥ Y ¥. ¥ Ly Netes U 

(2015) 

Fossum 4 a4 U Y Y Y ¥ Y Y 

(2017) 

Piwowar ¥ U U Y Y U me ¥ Y 

(2013) 

Thompson | Y U ly Note2 Y Y U na U Y 

(1974) 


Y= Yes, N=No, U=Unclear. 
Note 1 One significant difference in ethnicity of students 
Note 2 Educated in different schools 
Note 3 No, regarding observational data on student behaviour 


Targeted interventions 

The summary details of Review 2 studies aiming to improve the behaviour of targeted 
samples of students are shown in Table 7. Fifteen of the 25 studies are RCTs. The majority 
of comparator groups were treatment as usual. The targeted populations were typically 
children identified at risk of behaviour difficulties including disruptive behaviour, externalising 
problems and aggressive behaviour. Some samples comprised pupils at risk of or who 
struggled with emotional or behavioural disorders. Most samples were rated as at risk by 
teachers, rather than screened as above a threshold on a reliable and valid scale. Relatively 
few studies included samples with diagnosed behavioural concerns or school placement that 
indicated this level of behaviour problem. Sample sizes were often fewer than 100 
participants. As for the universal studies included in Review 2, there was a predominance of 
elementary and primary schools as the school level, rather than secondary school. Indeed, 
no sample was exclusively in secondary or high school. 


Table 8 shows details about the interventions for targeted students. As for the universal 
interventions, many interventions involved teacher training. Some focused on reward 
systems; these are programmes that involve the presentation of something such as a reward 
or praise, known as positive reinforcement, where the. goal is to achieve a desired response, 
such as listening or responding to a request. Unique to the targeted interventions were those 
that focused on training student skills (e.g. functional behavioural assessments). Those who 
delivered the intervention were often trained and fidelity was often assessed. 


Tables 9 and 10 show quality appraisal for these studies. The 15 RCTs rarely blinded 
treatment, delivery or assessment. Allocation to treatment groups was rarely concealed, or 
not reported clearly that it was concealed. Differences in the proportion of participants 
completing post-tests was less often described in these RCTs compared to universal 
interventions. Outcomes, data analysis and trial design were always free from bias. Quasi- 
experimental studies typically scored well on the criteria, free from bias on outcomes, control 
groups, analysis. Some studies did not have completed groups at post-test. 


Table 7. Study characteristics for Review 2 studies for targeted student samples 


Study Country Design Type of conirol Targeted sample Inclusion Criteria Sample size School level 
Axberg 2006 Sweden Quasi TAU Children who displayed Teachers reported child 50 children (34 Primary 
externalising behaviour misbehaving to pupil’s intervention 16 control) school 
problems (at risk) welfare conference 
Benner 2012 USA RCT TAU Children exhibiting According to threshold 70 children(n= 44 Elementary 
externalising behaviour on the Systematic treatment, 26 control) (Grades K-3) 
problems (at risk) Screening for Behaviour 
Disorders 
Bishop 1996 USA Quasi TAU Emotionally/behaviourally | Pupils in classes for 48 (28 intervention 20 High school 
disturbed students emotionally/behaviourally control) and 
(behavioural concerns) disturbed. Elementary 
school 
Breeman Netherlands RCT TAU Children with psychiatric Attending special primary 389 children (212 Primary 
2016 disorders (behavioural education for children intervention 177 control) school 
concerns) with psychiatric disorders (special 
education) 
Cook 2017 USA Quasi TAU Disruptive and off task Classes where 159 students Elementary 
classes (at risk) observations revealed off and Middle 
task behaviour >30% 
Cook 2018a USA RCT Attention control All children in classes with Classes where 203 children Middle 
high rates of disruptive observations revealed school 
behaviour/low attainment <65% AET score 
(a risk) 
Cook 2018b USA RCT Attention control All children in classes with Classes where 220 children Elementary 
high levels of observations revealed off 
disruptive/off-task task behaviour >20% 
behaviour (at risk) 
Durlak 1980 USA Quasi Waitlist Children with school Selected based on high 119 children (51 school Elementary 
adjustment problems (at scores on both AML and _ A, 42 school B, 26 
risk) TRF control) 
Eisenhower USA Quasi Delayed control children with behaviour Parent report or elevated 97 children Kindergarten 
(2016) problems (at risk) scores for behaviour or 


internalising problems 


Study Country Design Type of control Targeted sample Inclusion Criteria Sample size School level 
Forman USA RCT Placebo and Children with aggressive Referral to school 18 (14 intervention (7 Elementary 
1980 response cost behaviours (at risk) psychologist for cognitive, 7 response 
technique aggressive behaviour cost), 4 control) 
Forster 2012 Sweden RCT Other (Chemical Students with Teacher and SDQ 100 (60 intervention 40 Elementary 
Base Resolution externalising behaviour (at ratings for externalising control) 38 schools (26 
Lies In Education __ risk) behaviour intervention 12 control) 
(CHARLIE)) 
Fuchs 1990 USA Quasi TAU Difficult-to-teach students | Teachers one most 43 students (10, 10, 11 Middle 
(at risk) difficult to teach student intervention) (12 control) school 
Gettinger& USA RCT Treatment as children whose behaviours Two children per class 70 children & 41 pre- 
Stoiber Usual were disruptive, harmful to who exhibited teachers kindergarten, 
(2006) others, and/or interfered challenging behaviours kindergarten, 
with their learning (at risk) and 
first-grade 
classrooms 
Hops 1978 USA Quasi TAU Children with disruptive, Not reported 54 children (27 Elementary 
acting-out behaviour (at intervention 27 control) 
risk) 
lovannone USA RCT TAU Students with behavioural 5= critical events on 245 children Elementary, 
2009 problems (at risk) SSBD, persistent Middle, 
behaviour problems alternative 
schools 
Kirkhaug Norway Quasi Waitlist Children with clinical level 90" percentile + on 83 (45 intervention & 38 Elementary 
2016 externalising problems SESBI-R control) 
(behavioural concerns) 
Long 2018 USA Quasi TAU Alternative school for Attending this school 73 students Elementary 
students two or more 
grades behind and 
significant disciplinary 
problems (behavioural 
concerns) 
Palcic 2009 USA RCT TAU ADHD (behavioural Diagnosis and 98th 43 students Elementary 


concerns) 


percentile + on Conners 
screening 


Study Country Design Type of conirol Targeted sample Inclusion Criteria Sample size School level 
Randolph & USA RCT No treatment At risk of school dropout The six children 90 children (30 in each Elementary 
Hardage (at risk) screened by each intervention, 30 control) 
1973 teacher as having the 
highest drop- out 
potential in their class 
Reinke 2014. USA RCT TAU Students with disruptive Top 15% of TOCA-C 46 (23 intervention 23 Elementary 
behaviour (at risk) disruptive behaviour control) 
subscale 
Simonsen USA RCT TAU Children exhibiting Nominated by teacher as 42 children (27 Middle 
2011 frequent behavioural disruptive or 2+ office intervention 15 control) school 
problems (at risk) referrals in previous 
month 
Stoiber 2011 USA RCT TAU Children with challenging Two children per class 90 children 957 Pre-k to ist 
behaviours (at risk) teachers considered to intervention 33 control) Grade 
have challenging 
behaviour 
Trovato Canada RCT TAU Children exhibiting Identified by school 77 children (58 children Elementary 
1992 behavioural concerns (at evaluation as exhibiting results analysed) 
risk) behavioural concerns 
van den Netherlands RCT TAU Externalising behaviour (at teacher-identified 1569 children Elementary 
Berg 2018 risk) children with elevated 
levels of externalising 
behaviour at school 
Weinrott USA RCT Placebo Children described as Teacher rated 2+ 20 teachers/student Elementary 
1979 ‘acting-out’ (at risk) disruptive behaviours pairs (10 intervention, 


Table 8. Intervention details for Review 2 studies for targeted student samples 


and 3+ distractible 
behaviours 


10 control) 


Study 


Intervention name 


Intervention 
category 


Who receives the 
intervention? 


Who delivers? 


Duration 


Fidelity assessed? 


Axberg 
2006 


Benner 
2012 


Bishop 
1996 


Breeman 
2016 


Cook 2017 


Cook 
2018a 


Cook 
2018b 


Durlak 
1980 


Eisenhower 
(2016) 


Forman 
1980 


Forster 
2012 


Fuchs 1990 


Marte Meo Model 
Behaviour Intervention 
BTS 

GBG 

(5):(1) 

PGD 

EMR 


Behavioural treatment 
and relationship 
treatment 


Starting Strong 


cognitive restructuring 
and response cost 


COMET 


BC 


Teacher training 
Teacher training 
Student 
intervention 
Reward system 
Teacher training 
Teacher training 


Teacher training 


Teacher training 


Teacher (and 
parent) training 


Student 
intervention 


Student 
intervention 


Teacher training 


Teachers 
Principals, teachers, 
and staff 
Students 
Teachers & students 
Students 
Students 


Students 


Teaching Aides 


Teachers and 
parents who then 
adapt their approach 
to the children and 
each other. 


Students 
Teachers 


Teachers 


Trained professional 
Trained professional 
Unclear 

Consultants 
Teacher 

Trained professional 
Trained professional 


Trained professional 


Two leaders facilitate 
both parent and teacher 
groups at each school 


Trained professional 


Trained professionals 


e.g clinical psychologists 


Consultants 


Academic year 
5 months 

42 hours 

84 

School year 
School year 
10-12 weeks 


2 months 


4 months 


Unclear (6 days?) 


5 months 


Unclear 


Unclear 

Yes (coaches/observers) 
Yes 

Yes 

Yes (by teacher carrying 


out intervention) 


Yes (by teacher carrying 
out intervention) 


Yes (by teacher carrying 
out intervention) 


Unclear 


Yes 


Yes 
Yes 


Yes (by coaches) 


Stud i i i : i ae 
udy Intervention name Intervention Who receives the Who delivers? Duration Fidelity assessed? 
category intervention? 
Gettinger & Functionalassessment, Student Classroom teacher Teacher directly 2 years Yes 
Stoiber collaboration, and intervention supported by team of supported by team 
(2006) evidence-based school psychologist, 
treatment (FACET) school building 
principal, and at least 
one additional 
special service 
provider (e.g., social 
worker, speech and 
language therapist) 
all trained to support 
selected children. 
Hops 1978 CLASS programme Teacher training Teachers consultant trainers 2 months Unclear 
lovannone PTR Student Teachers PTR consultants 42 hours Yes (by 
2009 intervention coaches/observers) 
Kirkhaug lY TCM Teacher training Teachers and after- Qualified IY TCM group 83 (45intervention Yes 
2016 school staff leaders & 38 control) 
Long 2018 GBG&MST Reward system Students Teacher 2 years Yes (by teacher carrying 
out intervention) 
Palcic 2009 DRC Student Students Teacher 5 weeks Yes (integrity) 
intervention 
Randolph & CBM & group Teacher training Teachers and Trained professional 31.5 hours Unclear 
Hardage counselling students respectively 
1973 
Reinke lY TCM Teacher training Teachers Trained professionals 46 (23 intervention Yes (by coaches) 
2014 (IYTCM certified 23 control) 
leaders) 
Simonsen CICO Student Teachers & students Teachers 2 years Yes (by researcher) 
2011 Intervention 
Stoiber PBS Student Teachers Trained professional 5 months Yes 
2011 intervention 


Study Intervention name Intervention Who receives the Who delivers? Duration Fidelity assessed? 
category intervention? 
Trovato Teacher- Teaching training Teachers Trained professional 98 hours Yes 
1992 generated/consultant- 
supported behaviour 
intervention strategies 
van den Classroom seating Student Students N/A 2 years U 
Berg 2018 arrangement placement 
Weinrott Not specified Teacher training Teachers Not specified 20 teachers/student Yes (observers) 
1979 pairs (10 


intervention, 10 
control) 


Table 9. Quality appraisal for Review 2 targeted interventions using RCT design 


Study/Criteria 1. | 2. 3. 4. 5. 6. 7. 8. 9. 10. 11. 12. 13 

Benner 2012  G N Y N N U x U Y ¥: ¥- ¥ ¥ 

Breeman 2016 ‘ N Y N N N a4 ag na Y Y Y Y 

Cook 2018a ¥ N nd N ¥ ¥ ad N Ne i: 4 i Ne 

Cook 2018b ¥ N ¥ N N U ¥ N Y Y ¥ a ¥ 

Forman 1980 Y 4 U N N U Y N ¥ Y ¥ Y ¥ 

Forster 2012 U N x N N Y U N Y ¥ ¥ iy: Y 

Gettinger & Stoiber Y N Y U N U N ¥ ¥. ™ Y Y ¥ 

(2006) 

Hops 1978 ¥ N ad N N N ad od ae a4 ng od ng 

lovannone 2009 ¥ N Y N N N ¥ od % x ¥- % a 

Palcic 2009 U U Y N N Y ” Me Y Y 4 a4 ¥ 

Reinke 2014 N N vd N N N U U Y Y ¥ x Y 

Simonsen 2011 Y¥ N Y N N N ¥ U ¥ ne ¥ Y Y 

Stoiber 2011 ¥ N Y N N N ¥ U yy D4 iy ay y, 

Trovato 1992 U N ¥ U N N ¥ N ¥ Y y Y Y 

van den Berg 2018 ¥ ¥ ¥ ¥ ¥ “4 ¥ U na na nd Y Y 
Y= Yes, N=No, U=Unclear. 
1. Was true randomization used for assignment of participants to treatment groups? 2. Was allocation to treatment groups concealed? 3. Were treatment groups 
similar at the baseline? 4. Were participants blind to treatment assignment? 5. Were those delivering treatment blind to treatment assignment? 6. Were outcomes 
assessors blind to treatment assignment? 7. Were treatment groups treated identically other than the intervention of interest? 8. Was follow up complete and if not, 
were differences between groups in terms of their follow up adequately described and analysed? 9. Were participants analysed in the groups to which they were 
randomized? 10. Were outcomes measured in the same way for treatment groups? 11. Were outcomes measured in a reliable way? 12. Was appropriate statistical 


analysis used? 13. Was the trial design appropriate, and any deviations from the standard RCT design (individual randomization, parallel groups) accounted for in the 
conduct and analysis of the trial? 


Table 10. Quality appraisal for Review 2 targeted interventions with quasi-experimental design 


Study 1. Is it clear in 2.Were the | 3. Were the 4.Was | 5. Were there multiple | 6. Was follow up 7.Werethe | 8. Were 9. Was 
the study what | participants | participants there a | measurements of the | complete and if outcomes of | outcomes | appropriate 
is the ‘cause’ included in included in any | control | outcome both pre and | not, were participants | measured | statistical 
and what is the | any comparisons group? | post the differences included in ina analysis 
‘effect’ (i.e. comparisons | receiving intervention/exposure? | between groups in | any reliable used? 
there is no similar? similar terms of their comparisons | way? 
confusion about treatment/care, follow up measured in 
which variable other than the adequately the same 
comes first)? exposure or described and way? 

intervention of analysed? 
interest? 

Axberg Y Y as ¥ af y Y Y 4 

2006 

Bishop ¥ ¥ ¥ ¥ ¥ U ¥ Y Y 

1996 

Cook 2017 | Y BA ¥ * Y N x Y ¥ 

Durlak Ms ae 4 Y ¥ ¥ ¥ Y ¥ 

1980 

Eisenhower | Y Y Y¥ Y Y N Y Y 4 

2016 

Fuchs 1990 | Y ¥ ¥ ¥ Y Y ¥ Y ¥. 

Kirkhaug ¥ ¥ U ¥ Y Y Y Y Y 

2016 

Long 2018 | Y Y ¥. Y ¥. N D4 Y b 4 

Randolph & | Y vy ¥ v Y N x Y ¥ 

Hardage 

1973 

Weinrott ¥: U N vy. Y x x Y ‘% 

1979 


Y= Yes, N=No, U=Unclear. 


Review 2 quantitative synthesis 
Review 2 synthesis of the effectiveness of classroom interventions was conducted by 


categorising interventions. Firstly by universal interventions where intended recipients are all 
students, and secondly targeted interventions where participants meet certain inclusion 
criteria to receive the intervention. The latter were typically elevated scores on measures of 
behavioural difficulties. Universal interventions could be further categorised by teacher 
training, reward systems, teacher training that involved reward systems or physical activity. 


Universal interventions 

Fifteen of the 31 universal intervention studies included data that allowed for the calculation 
of effect sizes for behaviour outcomes (see table 11). Overall the median effect size was 
d=0.2, with an interquartile range quite narrow at 0.33, but indicating that some negative 
effects were seen. Only a third of these studies reported effects that were both positive and 
statistically significantly above zero. This ranged from three very large effects and two 
smaller effects in magnitude, but more precise given large sample sizes. Of those 
categorised as teacher training, nearly all included a specific reward system as part of this 
training. A similar median effect size was seen (d=0.23), as well as narrow interquartile 
range (0.263). Seven of these 12 studies were trialling the Incredible Years teacher 
classroom management intervention: together, these studies showed a smaller effect size 
for this intervention (median d=0.13, interquartile range 0.27). The range of effect sizes for 
this intervention may be due to different samples, outcome measurement, fidelity of 
intervention delivery and error that would be expected across a range of measures. Of the 
other interventions that involved teacher training with a reward system, Piwowar (2013) is 
notable for a large beneficial effect on behaviour (d=3.37, 95% Cl: 2.31 to 4.43)), although 
only 33 teachers participated. This KODEK programme involves a research-based 
classroom management programme for teachers that provides teachers with a new 
classroom management strategy which is reviewed as part of the final session. It is notable 
that this is one of few studies set in a secondary school (in Germany). Although the study 
quality and confidence interval do not directly call into question this very large effect, the 
quasi-experimental design, lack of clarity in some elements of reporting and some outcome 
measures designed by the research team suggest that further trials of this intervention 
should be encouraged to see if these effects hold. 


Finally, three studies of reward systems where effect sizes could be calculated showed 
differing effects. Two trials of the Good Behaviour Game showed little beneficial effect of the 
intervention (Humphrey et al, 2018; LeFlot, 2010), whereas Kamps’ (2015) trial of Class- 
Wide Function-Related Intervention Teams (CW-FIT), holds similarities being a group 


contingency game that reinforces appropriate behaviour, but demonstrated a very large 


effect size (d=2.00, 95% Cl: 1.62 to 2.38). Again this effect size is very large and study 
quality, design (RCT) or confidence interval do not immediately call this into question. 


However, another included study from the same research team where effect sizes could not 


be calculated by reviewers indicated more modest, but still beneficial, effects for the same 


intervention. 


Table 11. Effect sizes for Review 2 Universal studies 


Author/Date Intervention name | Intervention Category Behaviour outcomes Effect size (d) and 95° 
confidence interval 
Piwowar 2013 KODEK Teacher training (including Munich Observation 3.37 (2.31 to 4.48) 
reward system) Inventory & Observation 
of classroom 
management 
Fossum 2017 lY TCM Teacher training, including Sutter-Eyberg Student 1.31 (1.16 to 1.46) 
reward system Behavior Inventory- 
Revised; Teacher 
Report Form; Social 
Competence and 
Behavior Evaluation 
Hutchings 2013 | IY-TCM Teacher training, including Teacher-Pupil 0.51 (-0.64 to 1.66) 


reward system 


Observation Tool 


Evertson 1989 


School-based 
training programme 


Teacher training, including 
reward system 


Observed classroom 
behaviour 


0.33 (-0.40 to 1.06) 


Fernandez Teacher-Child Teacher training, including Teacher rated problem 0.31 (-0.06 to 0.68) 
(2015) Interaction Training | reward system behaviour 
(TCIT) 
McGilloway IYTCM Teacher training, including Strengths and 0.25 (-0.02 to 0.52) 
2010 IYTCM reward system Difficulties 
Questionnaire & 
Conners Teacher Rating 
Scale 
Ford 2018 IY-TCM Teacher training, including Strengths and 0.13 (0.04 to 0.22) 
reward system Difficulties 
Questionnaire 
Murray 2018 IYTCM Teacher training, including Revised Teacher Social | 0.12 (0.01 to 0.23) 
reward system Competence Scale & 
Conners Teacher Rating 
Scale 
Hickey 2017 lY-TCM Teacher training, including Strengths and 0.10 (-0.17 to 0.37) 
reward system Difficulties 
Questionnaire & 
Teacher-Pupil 
Observation Tool 
Aasheim 2018 IYTCM Teacher training, including Sutter-Eyberg Student 0.03 (-0.10 to 0.16) 
reward system Behavior Inventory- 
Revised & Teacher 
Report Form 
Han 2005 RECAP Teacher training, including Child Behaviour -0. 14 ( -0.49 to 0.23) 
reward system Checklist & Teacher 
Report Form 
Capella 2012 BRIDGE Teacher training (no reward Student-Teacher 0.20 (-0.13 to 0.53) 


system 


Relationship Scale; 
School Bullying 
Experience 


Questionnaire; Self- 
Perception Profile for 
Children; Behavior 
Rating Inventory of 
Executive Function 


Kamps 2015 CW-FIT Reward system Observed classroom 2.00 (1.62 to 2.38) 
behaviour 
Leflot 2010 Good Behaviour Reward system Observed classroom 0.09 (-0.14 to 0.32) 
Game behaviour & peer ratings 


of problem behaviour 


Humphrey 2018 | GBG Reward system Teacher Observation of | -0.09 (-0.17 to -0.01) 


Classroom Adaptation 
Checklist 


As can be seen in table 11 effect sizes could be calculated for 15 Review 2 universal 
studies. From table 4 we can see that the remaining studies included in Review 2 are 
categorised as teacher training including reward systems (5 studies), reward systems (8 
studies), teacher training without reward systems (two studies) and physical activity (one 
study). These categories indicate how the intervention intends to improve behaviour 
outcomes. The teacher training category represents those interventions that, with the 
support of coaches or trainers with behavioural expertise, encourage positive student- 
teacher relations by helping teachers to think of reasons students might misbehave and 
reflect on how they currently respond. The training can use one or more formats such as on- 
line, workshops, videos, and one to one or group sessions. The training in these other two 
studies (Gregory, 2014 and Okonofua, 2016) helped teachers to consider approaches that 
move away from labelling misbehaving students as troublemakers and exclusionary 
discipline. The intervention training supports teachers to develop more empathetic and 
respectful approaches and incorporate them into their teaching in a sustained way. Both 
these studies suggested by using the skills and knowledge developed in teacher training the 
rates of exclusionary discipline decreased. 


Teacher training including rewards systems category extends the simpler teacher training 
category described above with the addition of simple, short, feasible and reinforcing rewards 
or incentives such as tokens that can be exchanged, such as stickers, positive notes, free 
play, games and physical activity time. These rewards are used as behavioural support with 
the intention of improving behavioural outcomes, hence as a positive form of contingency 
management. The five studies (Caldarella et al, 2018; Evertson, 1995; Reinke et al, 2012; 
Reinke et al, 2018; Thompson et al, 1974) where effect sizes could not be calculated all 
reported improvements in behavioural outcomes, such as increased on-task engagement, 


reductions in disruptive and inappropriate behaviour, and increased pro-social behaviour. 


The studies in the reward system category have interventions that have components 
intended to encourage teachers to reinforce behaviours they want to increase such as 
learning and on-task behaviours. This category of intervention can be distinguished from the 
teacher training including reward systems category in that the focus here is on the reward 
system only. All eight studies narratively synthesised demonstrated positive behavioural 
outcomes, although the positive outcomes in the intervention in Rogeness et al (1977) did 
not continue into the second year of the study which they suggested was due to staff 
changes. Also, Spilt et al (2013) found no positive effects for those students with 
combinations of behavioural and social risks and those from dysfunctional families and 
suggest these groups may need additional targeted support. 


The final review 2 category is classroom physical activity (CPA) which involves students 
participating in a short period of games or activities as part of their usual academic lesson. 
This one study (Bartholomew et al, 2018), examined the impact of CPA on the amount of 
time students where on-task. They found that there was a positive relationship between CPA 
and time on-task. 


Other outcomes 

Table 12 displays the findings for outcomes from Review 2 universal intervention studies that 
were not characterised as behaviour. The 24 studies reported outcomes other than 
behaviour with many studies having more than one, e.g. both children and teacher non- 
behavioural outcomes in a single study. Given the research is focussing on children’s 
behaviour in schools, it is not surprising that the majority of outcomes were in some way 
focussed on teachers (with 18 distinct outcomes and 27 measures) and children (with 10 
distinct outcomes and 17 measures). Other outcomes were quality or fidelity of the 
intervention (5 and 6 respectively), whole school (both 2), cost (both 2) and with one study a 
home related non-behavioural outcome and measure. Of the child focussed outcomes 8 
studies had attainment as an outcome with the other 9 each a different outcome and 
measure. For teacher focus, teacher behaviour is the most common outcome in 4 studies 
and there are a further 16 other distinct outcomes and measures split across either one, two 
or three studies. While teacher and observer respondents form most of the respondents 
across the 45 measures, children were clearly asked to respond in 5 measures and parents 


in two measures. 


Due to the quantity of studies and strength of intervention effects, the teacher focused non- 
behavioural outcomes show the strongest benefits of all, with child focussed interventions 
having the second most positive effect. As there are small numbers of other outcomes and 


measures, we make no overall conclusions on their effects. However, the child focus 
attainment outcomes had notable positive effects as four studies had strong effects and 
three had weak effects out of 8 studies in total. 


Table 12. Non-behavioural outcomes for Review 2 Universal studies 


Author Intervention Intervention Category Outcome category: name of measure: - Outcome effect 
/Date name who the rater was (T=Teacher, C=Child, 
O=Observer, P=Parent, S=Staff) 

Aasheim lY-TCM Teacher training Attainment: academic — T Small positive effect 
(2018) (including reward 

system) 
Caldarella CW-FIT Teacher training Social validity - T & C Significant positive effects in both for students 
(2018) (including reward Attainment: academic competence - T at risk of EBD 

system) 
Capella BRIDGE Teacher training (no Relationship: student-teacher — T A significant positive effect 
(2012) reward system) 
Dolan Good Behaviour Reward system Attainment: reading - C/T (unclear) No evidence that the GBG improves students’ 
(1993) Game (GBG) reading 
Evertson School-based Teacher training All teacher behaviour outcomes — O, 
(1989) training (including reward measures: 

programme system) Instructional management Five of 12 ratings were significant. 


Room arrangement 

Rules and procedures 

Meeting student needs 
Managing student behaviour 
Classroom climate 

Organizing activities and physical 
space 

Handling student problems during 
seat work 

Managing instructional activities 
Dealing with misbehaviour 
Monitoring and maintaining 
accountability 

Personal Characteristics 


No significant effect 

Seven of 10 ratings were significant. 

No clear overall effect. 

A significant positive effect. 

A small positive effect 

Positive effect for preparation component only 


No significant effect 


No overall effect 

No effect 

Positive effect for keeping students responsible 
only 

Small positive effects for teacher as confident 
and enthusiastic only 


... continued 


Author Intervention Intervention Outcome category: name of measure: - who Outcome effect 
/Date name Category the rater was (T=Teacher, C=Child, 
O=Observer, P=Parent, S=Staff) 
Evertson Classroom Teacher training Attainment: reading comprehension — C & T Significant gains on reading and maths 
(1995) Organisation (including reward unclear attainment. 
and system) Attainment: mathematics computation — C & T 
Management unclear 
Program 
(COMP) 
Fernandez —_Teacher-Child Teacher training Teacher skill acquisition: teacher verbalisations: | Teachers skills improved and authors suggest 
(2015) Interaction (including reward -O teachers were very satisfied with the training 


Ford (2018) 


Gregory 
(2014) 


Hickey 
(2017) 


Humphrey 
(2018) 


Training (TCIT) 


IY-TCM 


My Teaching 
Partner- 
Secondary 
program (MTP- 
S) 


IY-TCM 


Good Behaviour 
Game (GBG) 


system) 


Teacher training 


(including reward 


system) 


Teacher training 


(no reward system) 


Teacher training 


(no reward system) 


Reward system 


Teacher satisfaction: with training— T 

Teacher stress — T 

Child mental health: difficulties - T & P 

Other mental health: child difficulties - T & P 

Other attitude towards school: How | feel about 

my school — C 

Other service use: child & adolescent service 

cost - P 

Teacher sensitivity - O 

Regard for adolescent perspectives - O 

Positive climate - O 

Instructional learning formats: varied use of 

instructional modalities and strategies - O 

Analysis and problem solving, engagement in 

activities that require synthesis, evaluation, and 

novel application of knowledge — O 

Other behaviour management: teacher 

strategies -T 

Behaviour (teacher & child): teacher-pupil — O 
Attainment: reading — O 


and it seemed to help alleviate teacher 
distress. 

A small improvement in teacher reported 
children’s mental health at 9-months with no 
effect evident from parent reports. 

No effect on how children feel about their 
school. 

No effect on service use costs 

Only a broad statement that statistical models 
showed that the program was beneficial, when 
accounting for a range of classroom, teacher, 
and student characteristics 


Significant positive effect on teaching 
strategies. 

No effect on teacher-pupil interactions 
No evidence it improves reading 


competencies" 


Classroom management: competencies — C & O 


Acceptability — T 


Hutchings lY-TCM Teacher training Behaviour (teacher & child): teacher-pupil - O Significant positive effect 
(2013) (including reward Other fidelity: teacher satisfaction - T No effect given for fidelity 
system) 
... continued 
Author Intervention Intervention Outcome category: name of measure: - who Outcome effect 
/Date name Category the rater was (T=Teacher, C=Child, 
O=Observer, P=Parent, S=Staff) 
Kamps Class-Wide Reward system Other teacher behaviour: praise, attention and Positive effects — frequency of praise and 
(2015) Function-related reprimands - O attention increased, reprimands decreased 
Intervention Other fidelity: procedural fidelity - O Intervention implemented with high fidelity 
Teams 
Leflot Good Behaviour Reward system Teacher's behaviour management: negative Use of negative remarks reduced. 
(2010) Game (GBG) remarks — O 
McGilloway lY-TCM Teacher training Behaviour management: teacher strategies -T Significant positive effects 
2010 (including reward Teacher stress —-O Significant positive effects 
system) Home — school collaboration — O Significant positive effects 
Intervention cost: comparison with similar lY-TCM cost is modest in comparison 
interventions - O 
Murray lY-TCM Teacher training | Academic competence/other learning — T No significant effect 
(2018) (including reward Classroom climate, behaviour management: Significant positive effect 
system) classroom assessment - O 
Teacher behaviour: coded impressions - O Small effect 
Other intervention acceptability: teacher High level of acceptance 
satisfaction - T 
Other SEL, academic: teacher social Small effect 
competence - T 
Teacher behaviour - T Small effect 
Piwowar KODEK Teacher training | Behaviour management: classroom Unclear effects. 
(2013) classroom (including reward management —T 
management system) Teacher knowledge: classroom management -T Significant increase in knowledge in 6/8 scores 


Unclear effects. 
Significant positive effect 


Reinke lY-TCM Teacher training Attainment - tests of achievement — O Positive effect 
(2012) (including reward 


system) 
Reinke lY-TCM Teacher training § Attainment: - reading and maths: T No significant effects 
(2018) (including reward Emotional dysregulation - O Significant reduction 
system) Social competence — O Significant positive effect 
Rogeness Behaviour Reward system Attainment: science research associate I|Q test— Significant positive effect 
(1977) modification & T or O unclear 
counselling Other anxiety: children’s anxiety — T or O Significant positive effect 
unclear 
... continued 
Author Intervention Intervention Outcome category: name of measure:-who Outcome effect 
/Date name Category the rater was (T=Teacher, C=Child, 


O=Observer, P=Parent, S=Staff) 


Spilt (2016) Good Behaviour Reward system Teacher behaviour: reprimands and praise - O Small positive effect 


Game (GBG) Self-concept: self-perception for children - C No effect 
Social: school liking and avoidance — C No effect 

Thompson _ Training in Teacher training Behaviour management: teacher positive and Significant positive effect 

(1974) behaviour (including reward negative events- O 
management system) 

Wills (2016) Class-Wide Reward system Teacher behaviour: praise and reprimands to Significant positive effects (increase in praise 
Function-related individuals and groups — O and reduction in reprimands) 
Intervention Classroom management: general and classroom 
Teams management — O 

Wills (2018) Class-Wide Reward system Teacher praise — O Significant positive effect 
Function-related Teacher reprimand - O Significant positive effect in 2 of 3 sites 
Intervention Classroom management: general and classroom Significant positive effects 


Teams management — O 


Targeted interventions 
Twenty out of 25 studies trialling targeted interventions reported statistics that allowed for the 


calculation of effect sizes for behaviour outcomes. Overall, the median effect size was larger 
than for the universal interventions (d=0.50), but with wide variation across studies 
(interquartile range 0.96). One might expect the larger median effect size, given the greater 
need for intervention in the samples and more intensive interventions. More than half of the 
studies showed statistically significant beneficial effects, although often the confidence 
intervals were wide on account of the smaller samples for these studies. Of the 11 studies 
categorised as teacher training, effect sizes were large, but varied from no effect to very 
large across studies (median d=0.58, interquartile range 0.87). There was a wider range of 
different interventions for targeted populations, with only two studies investigating the same 
intervention (Incredible Years Teacher Classroom Management, although with different 
populations: children at risk of disruptive behaviour (Reinke et al., 2014) versus children with 
severe externalising behaviour (Kirkhaug et al., 2016) (small beneficial effect d=0.09 to 
d=0.27)). There were mixed effect sizes for those teacher training interventions that involved 
consultants, ranging from d=0.11 to d=1.01. Large effect sizes were seen in all three studies 
trialling different interventions by Cook and colleagues (2017, 2018a, 2018b) that were 
situated in classrooms with high rates of disruptive and inattentive behaviour. These three 
interventions were relatively straightforward: Positive greetings at the door, prompts to praise 
at variable intervals and efforts to improve teacher-student relationships. Study quality and 
sample size do not appear to call into question these large effects. Perhaps the recruitment 
of classrooms from schools that had the most disruptive and off-task behaviour might 


account for the improvement compared to comparison classrooms. 


The seven interventions categorised as student interventions showed similar effect sizes as 
for teacher training (median d=0.58, interquartile range 0.95). The four interventions 
recording the larger effects were either functional behavioural assessment interventions 
involving a wide range of staff or used daily report cards, so all these interventions were to 
some extent tailored to the behavioural needs of individual children. Although, there is 
imprecision of some of these large beneficial effects as indicated by confidence intervals; 
this area therefore warrants further investigation. Finally, as for universal interventions, there 
was no evidence for benefit of the Good Behaviour Game for either sample (d= -.03). These 
were the only reward systems included that targeted certain populations. 


Table 13. Effect sizes for Review 2 Targeted studies 


Author/Date 


Intervention name 


Intervention 
Category 


Behaviour outcomes 


Effect size (d) & 95% 
confidence interval 


Cook (2017) 


Teacher training 


Behavioral Observation 
of Students in Schools 


1.39 (1.04 to 1.74) 


Cook (2018a) 


Teacher training 


Behavioral Observation 
of Students in Schools 


1.33 (1.03 to 1.63) 


Cook (2018b) 


Teacher training 


Behavioral Observation 
of Students in Schools & 
Student-Teacher 
Relationship Scale 


1.11 (0.83 to 1.39) 


Fuchs (1990) 


Behavioural 
consultation 


Teacher training 


Revised Behaviour 
Problem Checklist 


1.01 (0.12 to 1.90 


Axberg (2006) 


Marte Meo Model 


Teacher training 


Child Behaviour 
Checklist & Conners 
Parent Rating Scale 


0.7 (0.01 to 1.39) 


Benner (2012) 


Behaviour 
Intervention 


Teacher training 


Observation classroom 
behaviour 


0.58 (0.09 to 1.07) 


Eisenhower 
(2016) 


Starting Strong 


Teacher training 


Child Behaviour 
Checklist 


0.43 (0.02 to 0.84) 


classroom behaviour; 
Social Skills Rating 
System 


Kirkhaug et al | IY TCM Teacher training Sutter-Eyberg Student 0.27 (-0.23 to 0.77) 

(2016) Behavior Inventory 

Hops (1978) CLASS programme | Teacher training Observation classroom 0.11 (-0.75 to 0.97) 
behaviour 

Reinke et al lY TCM Teacher training Teacher-rated problem 0.09 (-0.49 to 0.67) 

(2014) behaviour 

Weinrott Not specified Teacher training Observation classroom -0.02 (-0.92 to 0.88) 

(1979) behaviour 

Palcic (2009) | DRC Student intervention | Observation classroom | 3.05 (1.98 to 4.12) 
behaviour 

Gettinger & Functional Student intervention | Observation classroom 1.37 (0.72 to 2.02) 

Stoiber (2006) | Assessment behaviour 

Collaboration 

Stoiber (2011) | PBS Student intervention | Classroom Competence | 0.86 (0.31 to 1.41) 
Observation Form 

lovannone PTR Student intervention | Social Skills Rating 0.58 (0.31 to 0.85) 

(2009) System; Academic 
Engaged Time 

Simonsen Check-in, Check- Student intervention | |eacher-rated problem 0.21 (-0.42 to 0.84) 

(2011) out behaviour; Observation 


van den Berg 


Classroom seating 


Student placement 


Teacher-rated problem 


0.06 (-0.20 to 0.32) 


(2018) arrangement behaviour & peer-rated 

problem and prosocial 

behaviour 
Forster et al COMET Student intervention | Brief Rating of -0.02 (-0.42 to 0.38) 
(2012) Externalizing Behaviour 

scale; Conners Teacher 

Rating Scale; 

Observation 
Breeman Good Behaviour Reward system Teacher-rated problem -0.03 (-0.23 to 0.17_ 
(2016) Game behaviour 


Long (2018) 


Good Behaviour 
Game 


Reward system 


Teacher-rated problem 
behaviour 


-0.03 (-0.58 to 0.52) 


From table 8 we can see there are six studies that have no calculated effect sizes, four are 
categorised as teacher training (defined as in the Review 2 universal interventions synthesis 
above) and two as student intervention. The student intervention category represents 
interventions that focus training or teaching directly on students whether through counselling 
or training carried out by school staff, outside experts or a combination of both. Students will 
have been selected or screened for inappropriate behaviours or emotionally disturbed 
disorders. The two other studies in this category (Bishop, 1996 and Forman, 1980) 
demonstrated beneficial behavioural effects such as reducing aggressive and disruptive 


behaviour or increasing on-task behaviour. 


The four other teacher training interventions (Trovato, 1992; Randolph & Hardage, 1973; 
Hops, 1978; Durlak, 1980) all had beneficial behavioural effects with increased on-task and 
appropriate behaviours. In addition Hops (1978) found behaviour changes increased 
significantly over three years of the study with decreasing requirements for students to be 
referred to special behavioural services and reduced placement of students in special 
classes. However, Durlak (1980) found behavioural improvements were more significant in 


students with moderate rather than severe behaviour problems. 


Other outcomes 

Table 14 displays the findings for outcomes from Review 2 targeted intervention studies that 
were not characterised as behaviour. In the 17 studies reporting outcomes other than 
behaviour there were three areas of focus; teachers (with 7 distinct outcomes and 12 
measures), children (9 and 13 respectively) and, quality and fidelity (both 5). When 
focussing on teachers, relationships were the most common outcome measure with 3 
studies. Of the child focussed outcomes 5 studies had attainment as an outcome. While 
teacher respondents form most of the respondents across the 30 measures, children were 
asked to respond in 4 measures (all child focussed) and parents in none. The strongest 
positive effect for any outcome was for the behaviour of teachers outcome, with all three 
studies reporting significant positive effects; all other outcomes were cumulatively less 
effective due to their lack of strength and the limited numbers of studies. 


Table 14. Non-behavioural outcomes for Review 2 targeted studies. 


Author /Date Interventionname_ Intervention Outcome category: name of measure: - who the rater 
Category was (T=Teacher, C=Child, O=Observer, P=Parent, 


Outcome effect 


S=Staff) 
Marte Meo Model Teacher Clinically significant 
Axberg (2006) training Behaviour and mental health — T improvement 
Behaviour Teacher Attainment: academic skills — O Small effect 
Benner (2012) Intervention training 
Bishop (1996) BTS Student Attainment: academic performance - Other (written No effect 
intervention assessment) 
Breeman GBG Reward system Relationship: teacher-child relationship — T No effect 
(2016) Social: children's social preference - C No effect 
Teacher's confidence: sense of self-efficacy - T Effect on engaging students only 
Feelings/stress: teacher's burnout - T No effect 
Feelings: child’s reflection on teacher-child closeness — C No effect 
Cook (2017) 5:1 Teacher Behaviour teachers: ratio of positive-to-negative Significant improvements in positive-to- 
training interactions — O negative interactions. 
Cook (2018) Establish-maintain- Teacher Acceptability: intervention rating — T Teachers found the PGD strategy to be 
EMR restore (EMR) training. Fidelity: Implementation -T feasible, reasonable, and acceptable. 
Fidelity of implementation is unclear 
Cook (2018) Positive greetings at Teacher Relationship: student-teacher — T Significant improvement in student- 
PGD the door (PGD) training Acceptability: intervention rating — T teacher relationships. 
(including Fidelity: intervention checklist -T Adequate levels of acceptability and 


reward system) 


Durlak (1980) Behavioural Teacher Behaviour, social: mood — T 
treatment and training 
relationship treatment 

... continued 


fidelity 
No significant effects 


Author /Date Interventionname_ Intervention Outcome category: name of measure: - who the rater Outcome effect 
Category was (T=Teacher, C=Child, O=Observer, P=Parent, 


S=Staff) 

Starting Strong Teacher and Relationship: student-teacher quality — T No significant effects in any category. 
Eisenhower parent training Student-teacher: closeness - T 
(2016) Student-teacher: conflict — T 

COMET Student Behaviour teachers: teacher reprimands - O Significant positive effects for both. 
Forster (2012) intervention Behaviour teachers: teacher praise — O 
Kirkhaug lY TCM Teacher Behaviour (closeness and conflict) — T No effect 
(2016) training Behaviour, attainment: academic performance — T Increased academic performance 
Long (2018) GBG&MST Reward system Wellbeing/academic: student subjective wellbeing No effect 

questionnaire —S 

Randolph & DRC Teacher Student Attainment: Grade point average - Other (school records) Significant positive effect 
Hardage consequences intervention Social: socioeconomic status - O Significant positive effect 
(1973) Attainment: school attendance - Other (school records) No effect 

CBM & group Teacher No effect 
Reinke (2014) counselling training Attainment - O 
Simonsen lY TCM Teacher Small effect 
(2011) training Attainment: Academic competence - T 

CICO Reward system Teacher competency: self-rating - T Significant positive effects in all 
Stoiber (2011) Teacher competency: accommodating children with outcome measures 


challenging behaviour - T 
Behaviour teachers: ecobehavioural variables — O 


Teacher- Teaching Positive effects for both, most 
van den Berg generated/consultant-training Behaviour/likeability: interpersonal liking - C (children in significant when students sat next to a 
(2018) supported behaviour class) well-liked and prosocial buddy, or when 
intervention Behaviour and social: group liking - C (whole class) they were initially disliked 


strategies 


Review 3 descriptive synthesis 
Moving now to review 3, where interventions were focused at a whole school level, twelve 


RCTs or quasi-experimental studies were included. The summary details of the included 
studies can be seen in Table 15. Four studies were a mix of whole school and classroom 
interventions (n=4). The studies were published between 1993 and 2016; they were mainly 
conducted in the USA (n=7), with none from the UK. The design of the studies included 
RCTs (n=7), which all included one treatment group, and quasi-experimental studies 

(n=5) with 1 to 3 treatment groups. Treatment-as-usual was the most frequent comparison 
type (n=8) and in RCTs randomisation was inevitably always at the level of school. Children 
were participants in all studies, exclusively so in three, but teachers (n=9), parents (n=1) and 
all staff (n=5) were also included in some studies. The reported number of recruited 
participants ranged from 48 to 12344 children, 102 to 1601 teachers, 1211 to 2000 staff, 
and 4 to 63 schools. Again school level was restricted to the primary level only in 

most studies (n=9), with middle, secondary or all levels each represented once each. Where 
reported there were between 7.3% and 53.5% female children in each study sample and 
only one study reported the mean and standard deviation age at 8.13 years (1.92). 


Table 16 provides details of thee interventions tested in these studies. Interventions were 
broadly categorised as either i) school systems for behaviour, ii) multiple interventions taking 
place within schools, or iii) training for staff. Where treatment time was reported clearly it 
lasted from 3 to 4 days over 2 years to 7 days. Of the twelve studies, only three failed to 
report assessment of fidelity. 


Table 17 reports study quality for the RCTs (n=5), true randomisation procedures were 
clearly used for assignment of participants to groups in three studies, but no studies made it 
clear whether or not allocation to intervention or comparator groups was concealed and in 
only two studies it was clear that groups were similar at baseline. None of those delivering or 
assessing the effects of the interventions were blind to group assignment, although this was 
unclear for observer assessors in one study. Groups were not treated identically other than 
the intervention of interest in three studies, this was not clear in the remaining two. Follow-up 
outcomes measures taking place beyond the end of the intervention were not completed in 
one study, while for three studies differences in number of participants completing post-test 
measures were unclear. In one study it was not clear that participants were analysed in the 
groups to which they were randomised. In all studies outcomes were measured in the same 
way for intervention and comparator groups. In four studies outcomes were measured in a 
reliable way, for the other this was unclear. All included studies applied appropriate design 
and analysis; any deviations from the standard RCT design (individual randomization, 


parallel groups) accounted for in the conduct and analysis of the trial. All studies applied 


similar measures to all comparison groups and measures were universally valid and reliable. 


Table 18 reports study quality for the quasi-experimental studies (n=7). In four studies, the 
participants included in any comparisons were similar, while for the remaining three studies 
this was not clearly reported. The participants included in any comparisons were receiving 
similar experiences, other than the exposure or intervention of interest in four studies, but 
this was unclear in two studies. There was a control group and multiple measurements of the 
outcome both before and after the intervention/exposure in all studies. Follow-up outcome 
measures were either used and if not, changes in the number of participants completing 
measures after the intervention period were adequately described and analysed in three 
studies. This was not the case in the remaining four studies. In all studies the outcomes of 
participants included in any comparisons were measured in the same way, with the use of 
valid and reliable measures and with appropriate statistical analysis with the exception of 
one study where the appropriateness of statistical analysis was not clear. 


Table 15. Study characteristics for Review 3 included studies 


Students: 24 
target students & 


Study Country | Design Type of Sample Sample size School Type of sample 
control level 
Bodin Sweden | Quasi Treatment as | Children 13 schools were | Eligible All children 
(2016) usual assigned to schools 
treatment (1,867 | comprised 
youth, 119 school 
teachers) grades 4-9 
and 10 to the (ages 
control group 10/11- 
(1,340 youth, 69 | 15/16) in 
teachers). public and 
private 
schools 
level not 
stated. 
Bradshaw | USA RCT TAU School staff & | 37 schools. Elementary | Whole schools 
2010 students 
Bradshaw | USA RCT TAU Children only | 12344 recruited, | Elementary | All children 
2012 (refrained 11738 analysed 
from 
implementing 
SWPBIS for 
4 years) 
Gottfredson | USA Quasi TAU All staff and 5719 students middle All children 
1993 students schools 
Holtzapple | USA RCT TAU Children & 8350 children, High school | All children 
2011 teachers 469 teachers 
Horner USA RCT Waitlist School staff & | 63 schools Elementary | Whole schools 
2009 students 
Nelson USA Quasi TAU Teachers & 102 teachers Elementary | Externalising 
1996 students baseline. behaviour and 


typical students 


24 matched 


nominated by 


criterion students teachers 
at baseline. 
Sorlie 2007 | Norway | Quasi TAU Children & 780 children & Elementary | All children 
teachers 108 teachers 
recruited. 
Sorlie 2015 | Norway | Quasi TAU Children & 48 schools, 1211 | Primary All children 
teachers staff members, 
5379 children 
Sorlie 2015 | Norway | Quasi. Treatment as | entire school | At baseline (T1), | Primary All 
usual staff and 37 schools with 
children 11,367 students 
in 1st to 7th 
grades and 1333 
employees. 
Ward & USA RCT Waitlist Whole school | 32 schools. Elementary | All children 
Gersten Approximately 
2013 2100-2200 staff 
responses. 
Approximately 
7500 student 
surveys. 
Waschbush | Canada | quasi Treatment as | Parents of all | 1,115 children Elementary | All children in 
2005 usual children their teachers 
invited to and parents. 


participate 


Table 16. Intervention details for Review 3 studies 


Intervention Intervention Whol hool Who receives th ' ' ee 
Study mervenuo evens ot : . wee ening Who delivers? Duration Fidelity assessed? 
name category details intervention? 
eer Positive school ee Researchers 
P T for | hil : h 
Bodin (2016) creer rules, and teacher paling sou re acess. “Gallarensteaenels and PS 24 months No 
School (PS) and all teachers and parents 


and parent training consultants 


SWPBIS coach 
SWPBIS team from (e.g. school 
universal prevention each school - 6-10 _psychologist/gui 


Bradshaw 2010 SWPBIS Systems & strategy that aims to staff members + dance Biyeare Yes - fidelity 
procedures alter the school administrator. Teamscounsellor, 
environment train other staff experience 
members. working with 
SWPBIS) 


Intervention schools 
formed SWPBIS 


Bradshaw 2012, teams, comprising 5 


; School-wide to 6 members (eg, 
School-Wide ; 
Positive Universal expectations for teachers, SWPBIS teams Petaes) 
' SWPBIS prevention. student behaviour, administrators). (teachers, Yes - fidelity 
Behavioural £7 ei ia: years 
Organisational which are taught to School-wide administrators) 
Interventions & ' 
all students and staff. behaviour 
Supports 


expectations are 
taught to all students 
and staff. 


i i Whol hool Who receives th 2 . cae 
Study ate rvention htervention a me ‘ > sa ous Who delivers? Duration Fidelity assessed? 
name category details intervention? 


team of teachers and 
administrators to 
prepare the school 


Multiple 


The program (not interventions: 


Gottfredson 1993 school-, classroom- School year Not reported School year Yes — implementation 
named) eececs for the program that 
, and individual- : 
would begin the next 
level 
fall. 
CKH 3 day 
teacher 
ining. P 
Holtzapple 2011 Capturing Kids Teacher & Teacher: . training. PC _ 
Hearts Campus _ administrator he 1 academic year Unclear 2 day Yes - fidelity 
CKH ; ae administrators 
by Design training teacher & 
administrator 
training. 
School-wide Regular state 
expectations for personnel aie ait 
Horner 2009 SWPBS Syetcis student behaviour, Heater stallion formally trained 2 years ues ; mnipementaten 
procedures each school Fidelity discussed. 


which are taught to in SWPBS 
all students and staff. practices 


Intervention Intervention Whole school Who receives the : , cane 
Study / ‘ : Who delivers? Duration Fidelity assessed? 
name category details intervention? 


Ecological factors, 


behavioural 
guidelines, 
supervision, 
disciplinary school-wide 
responses, organizational Researchers Se eee 
Nelson 1996 The project classroom practices to promote Whole schools and PS é No 
management, positive social consultants yea 
longitudinal behaviour. 
programming, 
focused 
interventions, 
reactive strategies 
Positive 3 years. 
; Post- 
behaviour, The core components 
’ interactions and Multi-level, multi- were defining and ; Certified PALS natin 
Sorlie 2007 ' , gic Children conducted No 
learning component establishing school- consultant DO: monihe 
environment in wide expectations atte 


school (PALS) baseline. 


Intervention Intervention Whole school Who receives the 


Study / ‘ : Who delivers? Duration Fidelity assessed? 
name category details intervention? 
Certified N- 
PALS coach. 
Schools 4 years 
School-Wide . POO = ieat 
a Altering the school teachers, 
Positive ; ee assessment 
Behaviour Multi-level, multi. &"/onment through PANERA, SEN! snducted 
Sorlie 2015 ; evidence-based Children psychologist & Yes - fidelity 
Support component . : after 3 years 
interventions and parent to plan, 
(SWPBS/N- ; ; : of 
inclusive strategies. inform, carry ; ; 
PALS) implementati 
out, monitor & 
on. 
report on the 
interventions & 
outcomes. 
The PPBS 
“Preventing sparc tne Training included a 
Problem Behavior. vice cate sessions were 30-hour in- 
Sorlie 2015 in School” g see study details All staff trained led by the service Yes 
program fora ee 
(PPBS) ; ; program training 
school’s entire staff 
intervention developers program for 


school staff 


Study 


Intervention 


Intervention 


eenole Senee! eno rece ves.tne Who delivers? Duration Fidelity assessed? 


name category details intervention? 
A comprehensive, 
multimedia program 
that guides staff 
Ward & Gersten Safe and Civil Positive behaviour through the process All school staff (see BRS sansulenk Sveas Veenipeciemsniaion 
2013 Schools (SCS) — support of designing a previous) y P 
positive and proactive 
school-wide discipline 
plan. 
The Behavior 
Ecucalion Teachers supported 
Support and Adherence to and PP ; 
; in all 3 interventions 
Treatment tracking of tod aliveeto Annes 
(BEST) School behavioural rules, ate No details just pp 
Intervention rewards, feedback Seas etigonisepoaienal two staff ialnings| 
Waschbush 2005 ates Universal.TH and TS interventionists (no month then Yes 
Program: and individual members/interve. 
; targetted details) helped eg interventions 
Schoolwide (SW),behavioural needs, ntionists 
teacher and for 9 months 
Targeted-School both at school and 
delivered programme 


(TS), and 
Targeted-Home 
(TH) Approaches 


home 


in homes. 


Table 17. Review 3 RCT quality table 


Bradshaw | Bradshaw Holtzapple Horner Homer Ward & Gersten 
Study (2010) (2012) (2011) (2009) (2016) (2013) 
1. Was true randomization used for assignment of participants to treatment 
groups? Ny Nate"! N Y¥ Y N Y 
2. Was allocation to treatment groups concealed? U U U U U U 
3. Were treatment groups similar at the baseline? yi U U Ler U Y 
4. Were participants blind to treatment assignment? N U N N N N 
5. Were those delivering treatment blind to treatment assignment? N N N N N N 
6. Were outcomes assessors blind to treatment assignment? N N N Note 3 N N 
7. Were treatment groups treated identically other than the intervention of 
interest? Ni heme U UNG N ¥: U 
8. Was follow up complete and if not, were differences between groups in 
terms of their follow up adequately described and analysed? U ed Uiene Nie? 7 U 
9. Were participants analysed in the groups to which they were randomized? U ¥. Y yee ¥ Y 
10. Were outcomes measured in the same way for treatment groups? ¥ ¥ x ¥ ¥ ¥ 
11. Were outcomes measured in a reliable way? ¥ U ¥ ¥ N ¥ 
12. Was appropriate statistical analysis used? ¥ Y n ¥ Y ¥ 
13. Was the trial design appropriate, and any deviations from the standard 
RCT design (individual randomization, parallel groups) accounted for in the 
conduct and analysis of the trial? ¥ hd ¥ ¥. ¥ ¥ 


Y= Yes, N=No, U=Unclear. 

Note 1 matched on select baseline demographics. 

Note 2 Significant difference in enrolments. 

Note 3 Teacher — N; Observer — U. 

Note 4 differences in school districts resources and infrastructure. 
Note 5 different schools have different discipline policies. 

Note 6 Intervention school withdrawn for non-adherence. 

Note 7 All schools included in analysis. 

Note 8 Some control schools removed due to accessing SWPBS. 


Table 18. Review 3 Quasi-experimental quality table 


Study Bodin Gottfredson | Nelson | Sorlie | Sorlie & | Sorlieet | Waschbush 
(2016) | (1993) (1996) (2007) | Ogden al (2015) | (2005) 
(2015) 


1. Is it clear in the study what is the ‘cause’ and what is the 
‘effect’ (i.e. there is no confusion about which variable N Y 7 y 7 ¥ Y 
comes first)? 


2. Were the participants included in any comparisons 


similar? Y U Y U Y " U 
3. Were the participants included in any comparisons 

receiving similar treatment/care, other than the exposure or Y U N Note 1 Y Y Y U 
intervention of interest? 

4. Was there a control group? 4 7 Y Y ¥ Y ¥ 
5. Were there multiple measurements of the outcome both Yy Yy Yy y y y y 


pre and post the intervention/exposure? 


6. Was follow up complete and if not, were differences 
between groups in terms of their follow up adequately Y N N N N ¥ Y 
described and analysed? 


7. Were the outcomes of participants included in any 


comparisons measured in the same way? a i ¥ ? a , * 
8. Were outcomes measured in a reliable way? i Y ¥ Y Y Y x 
9. Was appropriate statistical analysis used? bd v : U bd ¥ ¥ 


Y= Yes, N=No, U=Unclear. 
Note 1 Different schools. 


Review 3 quantitative synthesis 

Only five of the twelve studies had the data needed to calculate effect sizes for behaviour 
outcomes. Because these studies include quite different interventions, we have considered 
these studies separately rather than pooling any effect sizes. The median effect size from 
these studies is small (d=0.12). This fits with the median average effect size for school- 
based universal prevention programmes reported in a large systematic review (Tanner- 
Smith et al., 2018). However, Sorlie and Ogden (2007) (d=0.29, 95% Cl: -0.15 to 0.73) and 
more so Waschbush (2005) (d=0.57, 95% Cl: -0.21 to 1.35) show some promise, although 
the confidence intervals suggest a lack of precision for the beneficial effects on account of 
the small samples of teachers completing these behaviour outcome measures. Waschbush 
(2005) does differ from the other interventions in Review 3 as it incorporates both universal 
and targeted intervention elements. The universal intervention consisted of delivering 
behavioural components including school rules and a reward system to all students in the 
school. The targeted aspect of the intervention consisted of providing additions or 
modifications to the program to children who did not respond or by a consistent failure to 
meet the weekly reward goal. 


Table 19. Effect sizes for Review 3 studies 


Author/Date Intervention name Behaviour outcomes Effect size (d) & 95% 
confidence interval 
Waschbush 2005 | The Behavior Education Support and Teacher-rated problem 0.57 (-0.21 to 1.35) 
Treatment (BEST) School Intervention | behaviour 
Program: Schoolwide (SW) 
Sorlie 2007 PALS Teacher-rated problem 0.29 (-0.15 to 0.73) 
behaviour 
Bodin 2016 Prevention in School (PS) Teacher-rated problem 0.12 (-0.18 to 0.42) 
behaviour 
Nelson 1996 The project Devereux Behaviour 0.01 (-0.60 to 0.62) 
Rating Scale 
Gottfredson 1993 | All treatment Teacher and child-rated | -0.01 (-0.29 to 0.27) 
problem behaviour 


Of the remaining seven studies the two systems and procedures interventions (Bradshaw, 
2010 and Horner, 2009) aim to support appropriate behaviours and prevent disruptive 
behaviours by altering the school environment through improved systems (e.g., discipline, 
reinforcement, data management) and procedures (e.g., office referral, training, leadership). 
These improvements are hypothesised to lead to mutually supportive and positive 
behaviours amongst all the staff and students within the school. Following the intervention 
both studies reported that discipline referrals were low (although Horner had no experimental 
control to compare). 


A multi-level and multi-component intervention, called School-Wide Positive Behaviour 
Support (Sorlie, 2015), incorporates the approach used in the systems and procedures 
category supplemented by teaching of school rules, positive expectations and social skills, 
and systematic praise and encouragement of positive behaviour (including reward cards), 
monitoring of student behaviour, school-wide corrections with mild and immediate 
consequences (response cost), time-limited small-group instruction or training in academic 
or social topics, individual interventions and support plans, classroom management skills, 
and parent information and collaboration strategies. Also, those students with similar needs 
and difficulties receive education in academic or social topics, or positive support. Further, 
high-risk students receive individualized and functional behaviour support plans that can 
involve education and family interventions. Significant positive effects resulted in student 


problem behaviour with reduced numbers of segregated students. 


A universal prevention and organisational intervention (Bradshaw, 2012) uses a 3-tiered 
prevention framework in which 2 levels of selective and indicated programs are 
implemented. These complement the third tier which is the universal school-wide component 
used in the systems and procedures interventions. This study provides strong evidence that 
the intervention reduces levels of disruptive behaviour and concentration problems and 


increases prosocial behaviours. 


A teacher and administrator training with no focus on reward system intervention 
(Holtzapple, 2011) supports teachers to help students develop and use social skills. It also 
provides teachers with classroom management strategies and special training to selected 
staff to act as mentors to teachers. The intervention demonstrated improvements in 


prosocial behaviours and decreases the number of discipline referrals. 


A four-day in-service training program for a school’s entire staff intervention (Sorlie, 2015) 
Preventing Problem Behaviour in School incorporates elements of the Sorlie (2015) School- 
Wide Positive Behaviour Support intervention but focuses solely at the universal level. All 
staff are trained in combinations of differentiated evidence-based practices, reinforcement of 
expected prosocial behaviour, discipline for misbehaviours, good direction and establishing a 
functional support system. The intervention reduces problem behaviour throughout the 
school but more effectively outside the classroom. Also, beneficial effects were seen in 
positive behaviour management practices and to a lesser extent in disciplinary strategies to 


prevent and manage misbehaviour. 


A positive behaviour support intervention (Ward, 2013) consists of a program that helps 
teachers to develop a school-wide discipline plan that teaches appropriate behaviours and 
correct misbehaviours. The intervention produced improvements in student behaviour, 
reduced suspensions which were sustained into the second year of training. 

Table 20 displays the findings for outcomes from Review 3 whole school studies that were 
not characterised as behaviour. For the ten studies reporting outcomes other than 
behaviour, there were four areas of focus; teachers (with 7 distinct outcomes and 7 
measures), children (7 and 9 respectively), whole school (8 and 9), school system quality 
and fidelity (both 3). Only attainment and school climate were measured in multiple studies. 
All four attainment measures were positive, suggesting that whole school behaviour 
interventions may benefit attainment. Teachers are most often the respondents across the 
measures, although children were asked to respond in nine measures. However, there were 
no parent reports. 


Table 20. Non-behavioural outcomes for Review 3 studies. 


Author Intervention Intervention Category Name of measure/outcome - and who the rater Outcome effect 
/Date name was (T=Teacher, C=Child, O=Observer, 
P=Parent) 
Bodin Prevention in Positive school rules, | School rules: knowledge - C & T No significant effects in any outcome 
(2016) School (PS) | andteacher and parent Reported giving of reward — T measures. 
training Reported receipt of rewards — C 
Classroom climate: at 12 & 24 months —-C &T 
Being bullied: at 12 & 24 months — C 
Bradshaw SWPBIS Systems & procedures Other implementation: school-wide evaluation-O Across all outcome measures effects greatest 
(2010) Other behaviour system: effective behaviour among at-risk and high-risk children. 
support — T 
Attainment: assessment — C 
Gottfredson Alltreatment Multiple interventions: Other school climate: respect for students —C Schools that had high-implementation of the 
(1993) school-, classroom-, Other school climate: clarity of rules - C intervention improved most significantly on 
and individual-level Other school climate: fairness of rules - C student report of respect for students, rule 
Classroom Environment - T & C clarity, fairness of rules, and environment. 
Holtzapple Capturing Teacher & School climate/other prosocial: personal morality, Significant positive effects 
2011 kids’ hearts administrator training citizenship — O 
Horner SWPBS Systems & procedures School climate: school safety — T; Significant effect immediately after training 
(2009) then remained the same. 
Attainment: reading — C Tentative finding of reading improvements 
Other implementation: school-wide evaluation-—T Significant effect 
Nelson The project Ecological factors, Other learning: work habits - T Significant positive effects for work habits, 
(1996) behavioural guidelines, | Other learning: social growth - T social growth and attainment outcome 


supervision, disciplinary 
responses, classroom 
management, 
longitudinal 
programming, focused 
interventions, reactive 
strategies 


Attainment: language development - T 
Attainment: reading - T 

Attainment: maths - T 

Behaviour management: number of expulsions, 
suspensions & emergency removals - O 
Behaviour management: inventory - T 

Other teacher stress: effects of stress - T 
Other intervention acceptability: consumer - T 


measures. 


Significant positive effect 


Significant positive effect 
No effect 
Teachers were satisfied with the project 


... continued 


Author Intervention Intervention Category Name of measure/outcome - and who the rater Outcome effect 
/Date name was (T=Teacher, C=Child, O=Observer, 
P=Parent) 
Sorlie Positive Multi-level, multi- Other learning conditions/environment: - T & C Small negative effect 
(2007) behaviour, component Implementation quality - O Significant positive effect 
interactions Teacher attitudes/beliefs: collective efficacy - T Significant positive effect 
and learning 
environment 
(PALS) 
Sorlie SWPBS/N- Multi-level, multi- Other learning conditions/environment - T Greater effects in higher fidelity schools. 
(2015) PALS) component Implementation quality: effective behaviour 75% schools achieved target quality 
support — T 
Ward Safe and Positive behaviour Other school climate: rules and expectations are —_ Significant positive effect for all outcome 
(2013) Civil Schools — support clearly defined, a safe and secure environment is | measures 
(SCS) provided, formal school safety and student 
discipline policy exists, raining about school 
safety/ student discipline policy is provided for 
staff and discipline policy is enforced consistently 
-T 
Attainment: English language arts and maths—T — Significant positive effect (14% in maths and 
9% in English language arts) 
Waschbush Behaviour Adherence to and Relationships: conflict with teacher — T Significant positive effect 
(2005) Education tracking of behavioural Relationships: closeness with teacher — T Significant positive effect 
Support and ___ rules, rewards, Relationships: dependency on teacher — T Significant positive effect 
Treatment feedback and individual Impairment: peer - T Significant positive effect 
(BEST) behavioural needs, both Impairment: academic - T Significant positive effect (except TS 


at school and home 


Impairment: class behaviour - T 


intervention) 


Qualitative Comparative Analysis (QCA) Method 


A range of effect sizes were seen across studies included in Review 2 and Review 3, this 
was the case for studies using interventions which could be categorised in similar ways, e.g. 
reward programmes and teacher training. Therefore, we undertook some additional work to 
investigate whether certain components of interventions might better predict beneficial 
effects on behaviour. In order to further investigate how different combinations of 
components of interventions aiming to improve school behaviour lead to different outcomes 
in terms of student behaviour, we undertook qualitative comparative analysis (QCA). We 
focused on universal interventions, i.e. with samples that represented whole classes or 
schools, rather than those that focused on targeted groups of students, in the QCA reported 
here. The research question guiding this analysis was: What components of the universal 


behaviour interventions reviewed are effective for behaviour outcomes? 


Qualitative comparative analysis (QCA) is a method that takes a “case” rather than “variable” 
approach to analysis. Here a case is an intervention that has been evaluated as part of an 
included study in Review 2 or Review 3. QCA can identify complex (non-linear and non- 
additive) causal patterns and is appropriate in situations where there are limited cases and a 
large number of factors that may explain differences in findings. It is therefore particularly 
appropriate for systematic reviews of complex interventions where there is heterogeneity 
that might be explained by a number of intervention or contextual features. 


QCA uses set relations and formal Boolean logic to find commonalities between different 
cases with the same outcome (Rihoux & Ragin, 2008). In the current QCA the outcome is 
the effectiveness of a case (or intervention) for behaviour outcomes. QCA considers the 
necessity and sufficiency of conditions for an outcome, with ‘condition’ in this case denoting 
a particular intervention component or contextual factor. The focus of investigation is not the 
individual study or intervention trialled, but the different configurations of intervention or 
contextual conditions that together are responsible for interventions leading (or not) to the 


effective behaviour outcomes. 


Because QCA is focused on whether the presence or absence of conditions are important to 
trigger an outcome, a crisp-set QCA analysis sees conditions coded as 1 for present and 0 
for absent for each case (Thomas et al., 2014). In fuzzy-set QCA, as will be used here, 
greater flexibility in categorisation is possible. Here values between 0.5 and 1 are used to 


denote membership of a condition or set, and values between 0 and 0.5 used to indicate a 
spectrum of non-membership (Lee, 2014). 


Reviewers began by drawing a logic model that theorised the types of condition that might 
together impact behaviour outcomes for schoolchildren (see Figure 6). The logic model 
shows links between underlying causes of student behaviour and manifestation in the school 
and classroom context that is hypothesised to lead to change in behaviour for pupils. It drew 
upon Review 1 findings and logic models available for the interventions featuring in studies 
in Review 2 and 3 (although only Incredible Years Teacher Classroom Management and the 
Good Behaviour Game had logic models that could be located). We start from the 
perspective that school staff need to respond to disruptive behaviour and that this is linked to 
factors in and out of school. Pupil’s misbehaviour is seen as a manifestation of unresolved 
needs. The teacher will become aware of the pupil’s poor conduct or learning behaviours, 
which can be exacerbated when the pupil perceives the reaction from school staff and peers 
as negative, leading to a vicious circle of academic issues and negative attitudes to school. 
Poor learning behaviours will manifest as ineffective study skills, self-monitoring or 
functioning and conduct problems which all can lead to difficulty coping with academic and 
or emotional demands, resulting in pupil underachievement. In this model longer term 
outcomes for children on this pathway will be lower achievement and reduced skills and 
knowledge to meet challenges through their life course. 


The interventions we have reviewed are reactive and proactive approaches to prevent or 
minimise misbehaviour and promote learning behaviour and prosocial behaviour. They 
range from individualised approaches tailored to individuals to universal responses where all 
individuals in a class or school receive the same intervention. Some may take place within 
regular education settings without altering normal teaching and learning. A range of features 
of interventions might be predicted to improve behaviour. Other outcomes that might be 
impacted include attainment, coping and life skills. 


Figure 6. Logic model to theorise the conditions that may impact outcomes for school pupil behaviour 


Disruptive behaviour 


Misbehaviour 


Ecological / 

environmental 

needs 

factors in and 
out of school 


— Individual 


Manifestation in school/classroom 


Nn 


Academic issues or Negative interactions 


with 

Poor negative school attitudes school staff and peers 
conduct L wr, 

or learning Poor study skills, self- Difficulty in coping 

behaviours | monitoring or functioning with academic demands 


Difficulty in coping with 
interpersonal demands 


J Disrupts 
Peers 


Outcome 


Poor attainment 
= 


Reduced life 
and coping skills 


Response to ine 


Regular education settin 
ie 8 g a | 
Focus on misbehaviour, and 


| >Improved 


pro-social and learning behaviours 
> 


and teach learning behaviours 


Individual / group / universal 


Features of interventions 
Relationships (teacher-student or peer) | Whole school approach 
Coping and resilience education Teacher training 
Teachers collaborate Multi-component approach 
interaction Develop teacher knowledge of behaviour 


Reward systems 
Consult experts 
School/home 

Take time to embed 


>behaviour, 
attainment, life 
and coping skills 
and knowledge 


approach 


Identifying specific conditions that might impact on behaviour outcomes according to the 
logic model and other features of studies included in Review 2 and 3 that previous research 
predicts would impact behaviour outcomes. Although this initially suggested over 50 
conditions, these were reduced according to the theorised importance of the condition in 
predicting behaviour outcomes, the availability of data in the included studies and the spread 
of presence and absence of the condition in the included studies (Rihoux 2006). For 
instance, we were interested in whether a focus on behaviour in regular classroom settings 
might be a condition seen in effective interventions, but this could not be tested as all but 
one study analysed here had this focus. The conditions taken forward are indicated in the 
logic model. 


QCA Findings 


For the QCA analysis we followed the steps outlined by Moore and colleagues (2018) in their 
example of a QCA in a systematic review of interventions for ADHD in school settings. 


Building the data table 

Twenty-one studies included in Review 2 and Review 3 were used for this QCA, as they met 
the following criteria: i) included universal rather than targeted samples, ii) included data 
which allowed effect sizes to be calculated, iii) reported outcomes in terms of student 
behaviour. Coding of the conditions according to fuzzy set logic was agreed by two 
reviewers. One reviewer extracted data from original studies and this was checked by the 
second reviewer with any disagreements resolved through discussion. The codes 0, 0.33, 
0.55, 0.67, 1 were used as necessary to refer to partial or full membership of the condition 
for each case. The effect sizes for academic outcomes were also converted to fuzzified 
values between 0 and 1 using the calibrate command in the R 3.2.3 software package QCA. 


The data extraction and coding gave us a “data table”, i.e. a table consisting of rows that 
represent the cases (interventions tested in studies) and columns representing the 
conditions and outcome coded between 0 and 1. The twelve conditions appearing in the 
data table were whether: 1. Intervention targeted misbehaviour, 2. Intervention targeted 
prosocial behaviour, 3. Intervention targeted learning behaviour , 4. Intervention targets 
academic issues, 5. Intervention teaches coping and resilience skills, 6. Intervention is 
tailored to individual participants, 7. Intervention focuses on improving relationships (with 
teachers and/or peers), 8. Intervention is applied to whole school, 9. Intervention addresses 


home/school communication, 10. Intervention includes reward system, 11. Intervention 


includes more than 20 hours of teacher training, 12. Intervention includes teachers 
consulting with experts (see Appendix 4 for data table and criteria for coding). 


Constructing and checking a ‘truth table’ 

A truth table takes the data and organises cases by the combinations of causal conditions 
they exhibit, meaning rows are now specific combinations of the presence or absence of 
conditions and whether that combination is effective (higher effect sizes for behaviour 
outcomes). Because four to six conditions would usually be advised (Berg-Schlosser & De 
Meur, 2009) given the inclusion of 21 cases in the QCA, an iterative process was followed 
when constructing the truth table and determining the final conditions used. Five conditions 
appeared in the final truth table: Tailored to individuals, Targets academic issues, coping 
and resilience skills, relationships, and intensive teacher training (see Table 21). 


Table 21. QCA Truth table 


Conditions Outcome 
Tailored Targets Coping Relationships | Intensive EFFECTIVE | nof sufficiency | proportional 
to academic | and teaching cases | inclusion reduction in 
individuals | issues resilience training score inconsistency 
skills 
0 1 1 0 1 1 1 1 1 
1 0 0 1 1 1 1 1 1 
0 1 1 0 0 1 1 0.967 0.923 
1 1 1 1 1 1 1 0.854 0.706 
1 0 0 0 0 0 1 0.724 0.580 
0 1 1 1 0 0 1 0.682 0.324 
0 0 0 0 1 0 1 0.671 0.507 
0 0 0 0 0 0 4 0.470 0.345 
0 0 1 1 1 0 10 0.386 0.253 


Because targets academic issues and intensive teacher training were often present in 
configurations that gave effective academic outcomes, we considered whether one or both 
of these conditions would be enough to clearly explain the causal path to effectiveness, but 
found that the other three conditions were also important. Indeed, it was not enough to say 
that the presence of tailored to individuals or more teacher training gave effective outcomes 
as for some studies the outcome was ineffective when these conditions were present. Note 
that there are a range of configurations that are effective and ineffective according to the 
sufficiency inclusion score of 0.8 and that 4 of 21 cases appear in the effective 


configurations. 


Boolean minimisation 


This stage aims to simplify the four effective configurations from the data table. The 
intermediate solution that accounts for remainders — those configurations (n=21) where no 
cases provide information — and predicts that the presence of the five conditions should lead 
to effectiveness, as per the logic model, gave two pathways to effectiveness (see Figure 7). 
The solution coverage of 0.320 indicates the proportion of cases with an effective 
intervention that fit either pathway. Checks of this model indicated no contradictory 
configurations and that the model does not also explain ineffective behaviour outcomes, 
which suggests a good fit for the solution. 


Turning to the pathways to effectiveness for behaviour outcomes, the first includes the 
presence of tailoring to individual intervention recipients, a focus on improving relationships 
and over 20 hours (i.e. a greater amount than typical) of teacher training. The second 
pathway indicates that an alternative way of improving behaviour can be to focus on 
academic issues, teaching coping and resilience skills, but an absence of focus on improving 
relationships. 


Figure 6. Pathways to effectiveness from QCA findings. 
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Logical remainders 

Although there were 21 configurations out of a possible 32 that were remainders (meaning 
no cases provided evidence for effectiveness or ineffectiveness), interventions would be 
unlikely to fit all these configurations. It would be useful to have further data on 
configurations where interventions are both tailored to individuals and target academic 
issues; and both tailored to individuals and teach coping and resilience skills as these only 
appeared together in one configuration where studies provided data. 


Interpretation 

The first causal pathway suggests that tailoring an approach to classroom or school 
behaviour to individuals and focusing on building relationships can be effective, but this 
needs to occur with an appropriate amount of teacher training. An alternative is to focus on 
academic issues and teaching coping and resilience skills, but not focus on relationships. 
This might be interpreted as a response to behaviour that is more focused on individual 
student responsibility for behaviour and academic goals. An implication of these findings is a 
need to identify whether behaviour needs to improve in relation to a child’s socio-emotional 
development (first causal pathway) or a child’s academic development (second causal 
pathway). The behaviour management that might be most effective might be different in 
each scenario. Therefore a comprehensive behaviour management response needs to 
consider both aspects of development and evidence suggests this ought to be separate as a 
focus on improving relationships is only important in response to socio-emotional 
development. Looking across the four studies that fit the pathways, key commonalities seem 
to be improving teachers’ skills in behaviour management and finding a balance between a 
whole school approach to behaviour management that also retains the flexibility to respond 
to individual’s needs. Therefore future interventions that combine these approaches would 


warrant investigation. 


Discussion 


Summary 
In Review 1 we reviewed a wide range of research that has provided evidence that certain 


variables are linked to school behaviour. We located fifty-four articles which were 
synthesised to produce a model and categories of factors that influence school behaviour. 
Figure 4 suggests that positive influences are linked to positive behaviour and considering 
this relationship holds implications for monitoring, not just the reasons why an individual’s 
behaviour might slip, but to anticipate that some influences within and outside school may 
change behaviour. We categorised the variables that have been shown to influence 
behaviour in terms of the degree to which schools may impact these factors. Teaching and 
learning for instance is very much school-based, but aspects like relevance and perceived 
value of learning can influence behaviour. Home life may be something that can be impacted 
less directly by school, but parent involvement in learning can be encouraged by schools 
and awareness of life events or challenges can assist schools in appropriately targeted 


responses. 


In Review 2 we identified 61 studies that assessed the benefits of interventions primarily 
targeting school behaviour and delivered in classrooms. Thirty-one of these interventions 
were categorised as universal interventions delivered to all members of classes. Review 2 
universal interventions often provided small or large positive effects depending on the study 
in question. Whether the primary goal of the intervention was to put in place a reward system 
or not, these interventions trained teachers, most often with at least some benefit for 
resulting student behaviour. Some interventions trialled in isolated studies show promise and 
a number of studies trialling the Incredible Years Total Classroom Management programme 
together show small to medium beneficial effects of this intervention, whereas the effects of 
the Good Behaviour Game appear negligible. It would be useful to explore the conditions 
under which Incredible Years is most likely to be effective. It is notable that the included 
interventions focused on largely positive responses to the challenge of misbehaviour, 
training teachers to positively encourage learning behaviour and putting in place reward 
systems, rather than a focus on punitive measures. We did not detect any research 
investigating interventions that follow zero tolerance-type approaches to managing school 


behaviour. 


In Review 3 we identified 12 studies that assessed the benefits of interventions that primarily 
targeted behaviour at a whole school level. The whole school approaches often included 
some features of the Public Health England (2015) framework for a whole school 
intervention approach, although none contained all eight features depicted in Figure 2. Effect 
sizes tended to be in line with other school-based universal interventions, although a larger 
beneficial effect was seen for an intervention that combined both universal as well as 
targeted elements to a whole school approach to behaviour. 

In the qualitative comparative analysis we predicted components of interventions that would 
improve behaviour outcomes based on our Review 1 findings and previous logic models of 
included interventions. We then tested these conditions in 21 studies that included universal 
samples (i.e. child participants were representative of whole school). We found that two 
different combinations of components of interventions appear to predict effectiveness for 
behaviour outcomes. Firstly, tailoring to individual intervention recipients, a focus on 
improving relationships and over 20 hours of teacher training. The second pathway indicates 
that an alternative way of improving behaviour can be to focus on academic issues, teaching 
coping and resilience skills, but not to focus on improving relationships. 


Strengths and limitations 


Strengths of review 2 and 3 include the use of clear systematic review methods that aid the 
robustness of the review work and also allow for future updating of the work, not necessarily 
needing the review team. Review 1 takes an evidence-based approach to attempts to 
explain school behaviour, when teacher training texts often focus only on addressing 


behaviour. 


Few empirical studies have attempted to identify and theorise the full range of factors that 
influence school behaviour, therefore Review 1 brought together a 15 year old systematic 
review that held a similar research question and a range of often primary studies that 
investigated a small number of variables linked to behaviour rather than taking a more 
holistic approach. As we searched specifically for frameworks and models, it may be that 
there are other variables linked to behaviour not recognised in this review, because study 
authors have not framed the research in an explanatory, framework fashion. 

Review 2 and 3 involved a great deal of full text screening. This is indicative of the expansive 
intervention literature where behaviour might be a secondary outcome. Rather than duplicate 
previous reviews and not be able to provide detail on the most relevant interventions, we 
focused very specifically on interventions that primarily targeted improving school behaviour 
directly, excluding studies that may have hypothesised that behaviour would improve as a 
result of targeting primary outcomes such as social skills or attainment. However, this means 
that the review findings must be considered in light of other related work. If, for instance, 
improving problem solving and thinking skills both improves learning skills and behaviour, 
this might hold important implications. The findings from Review 3 might suggest that a 
whole school approach may not suit all students, but equally we had to focus on immediate 
post-intervention measures, as only one included study (Bodin 2016) recorded longer term 
follow up measures. Arguably, whole school approaches will need time to bed in to the 
school community and ethos and therefore follow up outcomes that measure the 
sustainability of any intervention effects ought to be recommended in future studies. 


QCA is limited to using conditions that are reported in included studies. While, we consulted 
previous literature through Review 1 to theorise how conditions might impact behaviour 
outcomes, not all conditions that might be relevant will be reported in a journal article write 
up or have the necessary spread of membership and non-membership of a condition. For 
instance, we were interested in whether tackling attitudes to school was an effective element 
of interventions, but this was only present in four cases, so did not have the necessary 
spread of membership to be tested. Furthermore, QCA holds the limitation that it is 
essentially analysing whether conditions are present or not and whether interventions are 
effective or not. Components of interventions or effectiveness is typically more nuanced than 


this and by calibrating the range of effect sizes in the 21 studies, effect sizes below 0.3 were 


considered ineffective (although effect sizes above 0.16 tend to be above the median for 


school-based universal interventions). 


Suggested recommendations 


A wide range of factors can influence school behaviour. Schools and teachers can 
only address some of these factors. Staff need to be conscious of some of the factors 
that may affect behaviour and consider these along with a response to misbehaviour. 
This review has focused on interventions clearly aiming to improve school behaviour, 
as such a range of studies that assess interventions indirectly improving behaviour 
are not considered. But a range of high quality reviews can be drawn upon to 
recommend that behaviour may be improved by focusing on other skills (e.g. problem 
solving or social and emotional learning) or factors (e.g. parent engagement, 
symptoms of externalising disorders). 

Either training teachers or putting in place clear reward systems can improve pupil 
behaviour in the classroom, not just for those pupils most likely to misbehave. A 
training programme that involves teachers reflecting on their classroom 
management, trying a new approach and reviewing their progress over time holds 
promise. 

For schoolchildren who are disruptive, both interventions that train teachers and put 
in place interventions in the classroom for these individuals can be highly beneficial. 
It appears that these interventions for targeted populations of students with more 
behavioural issues are often highly effective when they are tailored to the needs of 
the individuals involved, rather than attempting to implement the same strategies for 
all individuals. 

Looking beyond behaviour outcomes, interventions unsurprisingly often led to 
teachers using more behaviour management techniques. Effects on attainment were 
measured in some studies and findings seemed to be mixed. However, for whole 
school approaches to behaviour, there were more consistent beneficial findings in 
relation to attainment, which might be something to investigate in future research. 
Some relatively straightforward approaches to behaviour management in the 
classroom have shown very large effect sizes in isolated studies. It would be useful 
to see if these effects can be replicated in UK settings and of interest to compare 
such approaches and consider additive effects of different components of behaviour 
management like teacher-pupil relationships and praise. Likewise many, if not all, 
teachers recognise the importance of these elements of behaviour management, 


however, research appears not to have distinguished what are the key features of 
effective teacher-pupil relationships and praise. 

We had anticipated stratifying results according to school level, but were surprised to 
find that amongst 73 studies included in Reviews 2 and 3, only two studies were 
situated exclusively in high schools or secondary schools. There is a need for further 
research focused on secondary schools. 

Whole school behaviour programmes can improve behaviour across the student 
body, but these effects are not always large, which may speak to the time taken to 
embed a whole school change in behaviour or the difficulty implementing such 
programmes. One intervention combined a universal and targeted whole school 
approach, meaning that although a school may have a clear behaviour framework, 
within this can be flexibility to respond to those students who may struggle. 

It would be worth considering the extent to which whole-school approaches to 
behaviour interventions fit frameworks for whole school approaches more broadly. 
Are all staff trained? Is there shared responsibility? Are those in the wider school 
community involved? 

There are whole school approaches to behaviour management that do not appear to 
have been studied in randomised controlled trials and quasi-experimental studies. 
Therefore popular whole school approaches to behaviour management ought to be 
subject to robust research studies. This may include approaches such as zero 
tolerance behaviour policies, Teach Like a Champion and Ready to Learn. 

The QCA indicates that effective behaviour management might need to either focus 
on improving academic and coping skills or train teachers while tailoring approaches 
to individual students and focusing on improving relationships. This suggests the 
need to both focus on the more typical management of behaviour through equipping 
teachers with necessary skills and strategies, tailoring the approach to individual 
needs and improving relationships with teachers and peers. These approaches can 
operate both within classes and across the school, as well as acknowledging that 
when students have the skills to cope and achieve in the classroom behaviour is 
likely to improve. 

Finally, data linkage from trials to national databases would be helpful to be able to 
explore in more detail what factors may affect intervention effectiveness and indeed 
to test some of the ideas stemming from Review 1. More importantly, it would extend 
the duration of follow up and permit the study of real world outcomes, such as 
attainment, attendance and exclusions. This would have enabled some of the initial 
aims of the project to be realised such as which approaches to behaviour are most 


effective for pupils with special educational needs and to do a more thorough 
analysis of which approaches are most effective for pupils with more challenging 


behaviours. 
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Appendix 1 

Search Strategy used for Review 1 

Database: PsycINFO <1806 to October Week 5 2018> 

Search Strategy: 

1 (school* or classroom’).ti,ab. (403037) 

2 pupil*.ti,ab. (25528) 

3 student*.ti,ab. (473913) 

4 children.ti,ab. (464944) 

5 — schoolchildren.ti,ab. (3309) 

6 2or3or4or5 (913264) 

7 ((behavior* or behaviour*) adj3 (school or class*)).ti,ab. (17114) 

8 (behav* adj (poor* or bad’ or ill or challenging or aggressive or difficult)).ti,ab. (868) 
9 (willing* adj2 learn*).ti,ab. (315) 

10 ((ready or readiness) adj2 learn”*).ti,ab. (670) 

11. 7or8or9or 10 (18427) 

12  (model* or framework* or theor* or reconstructivis* or hypothes”).ti. (234583) 


13. 1and6 and 11 and 12 (390) 


Appendix 2. Quality appraisal for Review 1 studies 


Key 


Quality rating 


Criteria to guide assessment 


LOW Opinion, unsubstantiated arguments, restricted sample, eg one school. 


MEDIUM 


Small sample, eg two schools, appropriate analysis. Focus only on one variable's relationship with one measure of 
behaviour, literature review with unclear conclusions. 


GOOD Representative sample (national or large sample). Theory/framework/model tested. High quality review (although not 
systematic) 


EXCELLENT 


Systematic review. High quality. 


Table Quality appraisal for Review 1 - Aspects to Manage Directly 


Variable Name 


Theme 


Quality rating 


Studies providing evidence 


Teacher interest 


Relationships 


LOW 


Daniels & Williams (2000), Liaisidou (2016) NUfez (2015) 


Relationships MEDIUM Bitsika (2003) Lyons (2006) Nolan (2011) Olvera (2008) 
Relationships GOOD Sullivan (2011) Hastings (2005) 
Social Competency Relationships LOW Mooij (1999) 
Relationships MEDIUM Eve (1978) Bear (1994) Kemp (2003) Maggio (2016) Richards (1989) Richards (1984) 
Relationships GOOD Pingault (2015) 
Relationships LOW Cornwall (2015) Daniels & Williams (2000) 
Relationship with Peers 
Relationships MEDIUM Bear & Rys (1994) Bidell (2010) LaRoque (2008) Lopez (2005) Svendham (1994) 
Relationships GOOD Cheung (1997) Chirinos (2018) Sullivan (2011) 
Relationship Daniels & Williams (2000) Liaisidou (2016) 
Development Relationships LOW 
Relationships MEDIUM Haynes (1990) Jackson (1998) Lyons (2006) Svendham (1994) 
Relationships GOOD Heaven (2009) Sullivan (2011) 
Teacher Connection Relationships LOW Cornwall (2015) Hershfeldt (2009) Nufez (2015) 


Variable Name Theme Quality rating | Studies providing evidence 

Relationships MEDIUM Bitsika (2003) Haynes (1990) Hastings (2005) Nolan (2011) 

Relationships GOOD Heaven (2009) Nie (2009) 
Academic Achievement | Teaching and Learning | MEDIUM Cadieux (2003) Kerr (2000) 

Teaching and Learning | GOOD Adolphus (2013) Boon (2011) Chirinos (2018) McDermott (2001) 
Learning Potential Teaching and Learning | LOW Mooij (1999) 

Teaching and Learning | GOOD Garner (2011) 

Teaching and 
Educational opportunity | Learning MEDIUM Eve (1978) 

Teaching and 

Learning GOOD Dever (2016) Sullivan (2011) 
Connection to Teaching and Cornwall (2015) Ellis & Tod (2018) Hershfeldt (2009) 
Curriculum Learning LOW 

Teaching and 

Learning MEDIUM Borders (2004) Gottfredson (1994). 

Quality 

Variable Name Theme rating Studies providing evidence 
Exclusions/Suspensions | School organisation LOW Liaisidou (2016) Smith (2010) 

School organisation MEDIUM Bitsika (2003) Lyons (2006) Nolan (2011) Tremblay (2010) 

School organisation GOOD Smith (2010) Sullivan (2011) 

School organisation EXCELLENT | Finn (2003) 

Cornwall (2015) Daniels & Williams (2000) Hershfeldt (2009) Ellis & Tod (2018) 

School Ethos/Policies School organisation LOW Liaisidou (2016) 

School organisation MEDIUM Cadieux (2003) Nolan (2011) Norwich (1 993) 

School organisation GOOD Garner (2011) Smith (2010) 
School Transitions School organisation LOW Ellis & Tod (2018) 
School leadership School organisation LOW Daniels & Williams (2000) 

School organisation GOOD Garner (2011) 
Behaviour management Daniels & Williams (2000) Hershfeldt (2009) Liaisidou (2016) Lyons (2006) Nufez 
approach School organisation LOW (2015) 


Quality 


Variable Name Theme rating Studies providing evidence 
Bitsika (2003) Cadieux (2003) DiStefano (2008) Hastings (2005) Nie (2009) Norwich 
School organisation MEDIUM (1993) 
School organisation GOOD Garner (2011) Gottfredson (1994) Smith (2010) 
Definition of appropriate 
behaviour School organisation MEDIUM Bitsika (2003) Hastings (2005) 
School & community Cornwall (2015) Daniels & Williams (2000) Hershfeldt (2009) 
relations School organisation LOW 
School organisation MEDIUM Hastings (2005) Nolan (2011) 
School organisation GOOD Garner (2011) Smith (2010) Sullivan (2011) 
Class Size School organisation EXCELLENT | Finn (2003) 
Educational Motivation | Attitudes and self-concept | LOW Cornwall (2015) Nufez (2015) 
Attitudes and self-concept | MEDIUM Bidell (2010) 
Attitudes and self-concept | GOOD Adolphus (2013) Dever (2016) 
Variable Name Theme Quality Studies providing evidence 
rating 
Academic Expectations | Attitudes and self-concept MEDIUM Borders (2004) Norwich (1993) 
Attitudes and self-concept GOOD Chirinos (2018) Dever (2016) 
Attitudes to Learning Attitudes and self-concept LOW Cornwall (2015) Daniels & Williams (2000) 
Attitudes and self-concept MEDIUM Borders (2004) Kemp (2003) Norwich (1993) 
Attitudes and self-concept GOOD Dever (2016) Nie (2009) Sullivan (2011) 
Labelling Attitudes and self-concept GOOD Cheung (1997) 
Happiness Attitudes and self-concept MEDIUM Bidell (2010) Kerr (2000) 
Personal Perception of LOW 
Consequences Attitudes and self-concept Cornwall (2015) 
Attitudes and self-concept MEDIUM LaRoque (2008) 
Attitudes and self-concept GOOD Sullivan (2011) 
Self-evaluation Attitudes and self-concept LOW Cornwall (2015) Daniels & Williams (2000) Hershfeldt (2009) 


Variable Name Theme Quality Studies providing evidence 
rating 
Attitudes and self-concept MEDIUM Bidell (2010) Eve (1978) Haynes (1990) Jackson (1998) Lopez (2005) 
Emotional regulation Attitudes and self-concept LOW Daniels & Williams (1999) Ellis & Tod (2018) Mooij (1999) 
Bidell (2010) Jackson (1998) Lochman (2002) Lopez (2005) Lyons (2006) Maggio 
Attitudes and self-concept MEDIUM (2016) Nelson (1999) 
Attributions Attitudes and self-concept LOW Liaisidou (2016) Nufiez (2015) 
Attitudes and self-concept MEDIUM Bitsika (2003) Eve (1978) Hastings (2005) Hershfeldt (2009) Lochman (2002) 
Attitudes and self-concept GOOD Chirinos (2018) Dever (2016) Heaven (2009) 


Table Quality appraisal for Review 1 - Aspects to Identify and Influence 


Variable Name Theme Quality rating Studies providing evidence 

Choice of peers Relationships out of school MEDIUM Svendham (1994) LaRoque (2008) Lopez (2005) 
Relationships out of school GOOD Sullivan (2011) Cheung (1997) 

Relationship with 

Others Relationships out of school LOW Daniels & Williams (1999) Ellis & Tod (2018) 
Relationships out of school MEDIUM Bear & Rys (1994) Jackson (1998) Kemp (2003) Lochman (2002) 
Relationships out of school GOOD Sullivan (2011) 

Peer Group Perception 

of Consequences Relationships out of school MEDIUM LaRoque (2008) 

Family relationships Relationships out of school LOW Ellis & Tod (2018) 
Relationships out of school MEDIUM Haynes (1990) Kemp (2003) Gtlleg (2011) 
Relationships out of school GOOD Caughy (2007) Lorber (2011) Sullivan (2011) 

Social Support Relationships out of school MEDIUM Jackson (1998) 
Relationships out of school GOOD Knutson (2004) Liao (2015) 

Discipline Home life MEDIUM Lochman (2002) 
Home life GOOD Knutson (2004) Kemp (2003) 

Parental Involvement in 

Homework Home life MEDIUM Bitsika (2003) Lochman (2002) 
Home life GOOD Caughy (2007) Smith (2010) 


Variable Name Theme Quality rating Studies providing evidence 
Negative Life-Events Stressors MEDIUM Jackson (1998) Kerr (2000) 
Stressors GOOD Boon (2011) Liao (2015) Lorber (2011) 
Response Stressors MEDIUM Eve (1978) Maggio (2016) 
Stressors GOOD Boon (2011) 
Adaptive Functioning Stressors MEDIUM DiStefano (2008) Eve (1978) Jackson (1998) Maggio (2016) Olvera (2008) 
Stressors GOOD Boon (2011) Heaven (2009) Kerr (2000) McDermott (2001) 
Emotional Functioning | Stressors MEDIUM Jackson (1998) Olvera (2008) 
Stressors GOOD Heaven (2009) 
Behavioural 
Functioning Stressors MEDIUM Eve (1978) Jackson (1998) Lyons (2006) Olvera (2008) 
Quality 
Variable Name Theme rating Studies providing evidence 
Behavioural 
Functioning Stressors GOOD Heaven (2009) Kerr (2000) Pingault (2015) 
Coping and resilience Stressors MEDIUM DiStefano (2008) Gottfredson (1994). Lochman (2002) 
Stressors GOOD Boon (2011) 
Anti-Social Behaviour Behaviour out of school LOW Mooij (1999) 
Behaviour out of school GOOD Heaven (2009) 
Incarceration Behaviour out of school LOW Slee (2014) 
Intellectual Ability Ability LOW Mooij (1999) 
Ability MEDIUM Borders (2004) Jackson (1998) Kerr (2000) 
Breakfast Nutrition EXCELLENT | Adolphus (2013) 
Social and welfare 
services Out of school support LOW Daniels & Williams (1999) Ellis & Tod (2018) 
Social and welfare 
services Out of school support GOOD Pingault (2015) 


Table Quality appraisal for Review 1 - Aspects to be Aware of. 


Quality 


Variable Name Theme rating Studies providing evidence 
Sociometric Status Home life LOW Cornwall (2015) Hershfeldt (2009) Mooij (1999) 
Home life 
MEDIUM | Jackson (1998) Richards (1989) Richards (1984) Tremblay (2010) 
Home life 
GOOD Bear & Rys (1994) Caughy (2007) Knutson (2004) Sullivan (2011) 
Home life 
Family Functioning LOW Cornwall (2015) Hershfeldt (2009) Ellis & Tod (2018) Mooij (1999) 
Home life 
MEDIUM | Dinh (2001) Guleg (2011) Kemp (2003) Nelson (1999) Olvera (2008) Tremblay (2010) 
Home life 
GOOD Boon (2011) Caughy (2007) Cheung (1997) Lorber (2011) 
Home life 
Witnessing Violence MEDIUM | GUleg (2011) 
Home life 
GOOD Liao (2015) 
Parental Mental Health and | Home life GOOD Caughy (2007) 
Wellbeing 
Home life GOOD Boon (2011) Caughy (2007) 
Parental Education Level 
Home life MEDIUM | Gileg (2011) 
Parental view of Education 
Home life GOOD Chirinos (2018) 
Home life 
Abuse GOOD Knutson (2004) 
Culture LOW Cornwall (2015) Ellis & Tod (2018) Mooij (1999) 
Culture Conflict 
Culture MEDIUM | Bitsika (2003) Eve (1978) Richards (1989) 
Acculturation Culture MEDIUM | Bear & Rys (1994) Dinh (2001) Hershfeldt (2009) 


Appendix 3. Search strategy used for Reviews 2&3 
Database: PsycINFO <1806 to September Week 4 2018> 


Search Strategy: 

1 school*.ti,ab. (359749) 

2 pupil*.ti,ab. (25485) 

3. student*.ti,ab. (472333) 

4 children.ti,ab. (463491) 

5 schoolchildren.ti,ab. (3299) 

6 2or3o0r4or5 (910328) 

7 classroom*.ti,ab. (80486) 

8 school based.ti,ab. (13632) 

9 whole school.ti,ab. (912) 

10 7or8or9 (93179) 

11 teacher*.ti,ab. (170881) 

12 (manag* adj4 behavio?r*).ti,ab. (13959) 

13 (strateg* adjS (manag* or control* or improv* or modif*)).ti,ab. (35017) 
14 _ intervention*.ti,ab. (337801) 

15 (approach or approaches).ti,ab. (470734) 

16 110r12 or 13 or 14 or 15 (909454) 

17 (behavior* or behaviour*).ti,ab. (870629) 

18 comparison.ti. (53006) 

19 (comparison adj2 (children or group*)).ab. (16158) 
20 control group.ab. (63698) 

21 experiment*.ab. (378749) 

22 random*.ab. (178384) 

23 systematic*.ti,ab. (109351) 

24 _ effectiveness.ti,ab. (140375) 

25 18o0r19 or 20 or 21 or 22 or 23 or 24 (802914) 


26 1and6and 10 and 16 and 17 and 25 (2875) 


Appendix 4 Data table for QCA 


Study/ca 
se 


Targets 
misbeha 
viour 


Targets 
prosocia 
I 
behaviou 
r 


Targets 
learning 
behaviou 
r 


Tackles 
academi 
c issues 


Teaches 


resilienc 
e 


Tailored 
to 
individua 
Is 


Improve 
s 
relations 
hips 


Home/Sc 
hool 
commun 
ication 


Includes 
reward 
system 


Intensive 
teacher 
training 


Teachers 
consult 
with 
experts 


Kamps 
2015 


0.33 


1 


0.33 


0 


0.33 


0 


0.33 


Leflot 
2010 


0.33 


0 


0 


0.33 


0 


0.33 


0.66 


Humph 
rey 
2018 


0.33 


0.67 


Aashei 
m 2018 


0.66 


Everts 
on 
(1989) 


0.33 


Fernan 
dez 
(2015) 


Ford 
(2018) 


Fossu 
m 
(2017) 


Han 
(2005) 


Hickey 
(2017) 


Hutchi 
ngs 
(2013) 


McGillo 
way 
(2010) 


Murray 
(2018) 


Piwow 
ar 
(2013) 


Capell 
a 


(2012) 


Bodin 
(2016) 


Gottfre 
dson 
(1993) 


Nelson 
(1996) 


Sorlie 
(2007) 


0.33 


0.33 


Wasch 
bush 
(2005) 


Condition Codin | Criteria 
g 
Targets 0 No focus on misbehaviour 
misbehaviour | 9 33 Focusses on misbehaviour e.g. by improving or modelling good 
behaviour 

0.66 Focusses on tackling misbehaviour - to an extent identifies what are 
problem behaviours and seeks to tackle them either by discipline or 
training behaviours. 

1 Focusses on tackling misbehaviour - clearly identifies problem 
behaviours and successfully tackles them either by discipline or training 
behaviours. 

Targets 0 Not at all 

prosocial 0.33 Intervention probably benefits prosocial behaviour 

peuewiour 0.66 Intervention has an indirect benefit to prosocial behaviour or social 
behaviour that can be regarded as prosocial behaviour. 

1 Intervention successfully targets prosocial behaviour or social behaviour 
that can be regarded as prosocial behaviour. 

Targets 0 No focus on learning behaviour 
learning 0.33 Probably improves good learning behaviour with unclear outcomes. 
behaviour : Z ia 

0.66 Some focus on learning behaviours which improves them 

1 Clear focus on addressing learning behaviours - identifies what are 
inappropriate learning behaviours and successfully develops new 
learning behaviours. 

Tackles 0 No discernible influence on academic issues 
academic 0.33 An indirect focus on academic issues but no sign they improve or some 
issues in some classes which do improve 

0.66 An indirect focus which improves whole school academic issues or a 
direct focus on some classes which do improve 

1 Intervention targets and improves whole school academic issues 

Teaches 0 No indirect or direct focus 
coping and 0.33 Intervention indirectly benefits some children's coping and or resilience 
resilience : 7 

0.66 Some focus on coping and resilience 

1 A clear focus on coping and resilience which is stated as benefitting 
children 

Tailored to 0 Everyone is treated the same - universal 
individuals 0.33 | Auniversal intervention with some flexibility between classes/individuals 

0.66 The intervention is only for certain groups of students, or within a 
universal or targeted intervention certain students get an intervention 
tailored to their needs 

1 All participants receive an intervention that is tailored to their needs in 
some way 

Improves 0 No relationships in school are likely to be improved by the intervention 
relationships — | 0.33 There is likely to some improvement in relationships but it is not 
targeted. 

0.66 It is clear that indirectly the intervention has some benefit to 
relationships 

1 At least some of intervention directly aims to improve relationships 

Whole school | 0 Could not be focussed at whole school 

0.33 Could be extended to whole school but focussed on individual classes 

0.66 Could be extended to whole school but focussed on year groups 

1 Focussed at whole school 

0 No evidence of school/home interaction (other than child participation 


consent) 


Home/School | 0.33 The maybe some school / home interaction e.g. survey 
communicatio | 0.66 Clear indirect home school effects 
1 Addresses school / home interaction 
Includes 0 Complete absence of reward system 
reward system | 0.33 No direct reward process but child likely to be rewarded 
0.66 Intervention includes reward system but unclear extent of take-up 
1 Reward system tested that improves behaviours 
Intensive 0 Less than 11 hours of teacher training 
teacher 0.33 11-20 hours of teacher training 
eng 0.66 21-44 hours of teacher training 
1 45+ hours of teacher training 
Teachers 0 Not at all 
consult with 0.33 Some teachers may have consulted with experts beyond the training 
experts process 
0.66 Most teachers probably consulted with experts beyond the training 


process. 


All teacher consulted with experts beyond the training process 


